Oct 25 17:42:53 user nova-compute[74739]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74739) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 17:42:53 user nova-compute[74739]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74739) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 17:42:53 user nova-compute[74739]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74739) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 25 17:42:53 user nova-compute[74739]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 25 17:42:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:42:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:42:53 user nova-compute[74739]: INFO nova.virt.driver [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 25 17:42:54 user nova-compute[74739]: INFO nova.compute.provider_config [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Acquiring lock "singleton_lock" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Acquired lock "singleton_lock" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Releasing lock "singleton_lock" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Full set of CONF: {{(pid=74739) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ******************************************************************************** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Configuration options gathered from: {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ================================================================================ {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] allow_resize_to_same_host      = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] arq_binding_timeout            = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] backdoor_port                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] backdoor_socket                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] block_device_allocate_retries  = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] block_device_allocate_retries_interval = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cert                           = self.pem {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute_monitors               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] config_dir                     = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] config_drive_format            = iso9660 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] config_source                  = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] console_host                   = user {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] control_exchange               = nova {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cpu_allocation_ratio           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] daemon                         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] debug                          = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_access_ip_network_name = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_availability_zone      = nova {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_ephemeral_format       = ext4 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_green_pool_size        = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] default_schedule_zone          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] disk_allocation_ratio          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] enable_new_services            = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] enabled_ssl_apis               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] flat_injected                  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] force_config_drive             = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] force_raw_images               = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] graceful_shutdown_timeout      = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] heal_instance_info_cache_interval = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] host                           = user {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_build_timeout         = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_delete_interval       = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_name_template         = instance-%08x {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_usage_audit           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_usage_audit_period    = month {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] internal_service_availability_zone = internal {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] key                            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] live_migration_retry_count     = 30 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_config_append              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_dir                        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_file                       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_options                    = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_rotate_interval            = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_rotate_interval_type       = days {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] log_rotation_type              = none {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] long_rpc_timeout               = 1800 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_concurrent_builds          = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_concurrent_live_migrations = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_concurrent_snapshots       = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_local_block_devices        = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_logfile_count              = 30 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] max_logfile_size_mb            = 200 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] maximum_instance_delete_attempts = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metadata_listen                = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metadata_listen_port           = 8775 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metadata_workers               = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] migrate_max_retries            = -1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] mkisofs_cmd                    = genisoimage {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] my_ip                          = 10.0.0.210 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] network_allocate_retries       = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] osapi_compute_listen_port      = 8774 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] osapi_compute_unique_server_name_scope =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] osapi_compute_workers          = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] password_length                = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] periodic_enable                = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] periodic_fuzzy_delay           = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] pointer_model                  = ps2mouse {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] preallocate_images             = none {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] publish_errors                 = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] pybasedir                      = /opt/stack/nova {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ram_allocation_ratio           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rate_limit_burst               = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rate_limit_except_level        = CRITICAL {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rate_limit_interval            = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reboot_timeout                 = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reclaim_instance_interval      = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] record                         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reimage_timeout_per_gb         = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] report_interval                = 120 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rescue_timeout                 = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reserved_host_cpus             = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reserved_host_disk_mb          = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reserved_host_memory_mb        = 512 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] reserved_huge_pages            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] resize_confirm_window          = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] resize_fs_using_block_device   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] resume_guests_state_on_host_boot = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rpc_response_timeout           = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] run_external_periodic_tasks    = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] running_deleted_instance_action = reap {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] running_deleted_instance_timeout = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler_instance_sync_interval = 120 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_down_time              = 720 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] servicegroup_driver            = db {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] shelved_offload_time           = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] shelved_poll_interval          = 3600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] shutdown_timeout               = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] source_is_ipv6                 = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ssl_only                       = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] state_path                     = /opt/stack/data/nova {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] sync_power_state_interval      = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] sync_power_state_pool_size     = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] syslog_log_facility            = LOG_USER {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] tempdir                        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] timeout_nbd                    = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] transport_url                  = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] update_resources_interval      = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_cow_images                 = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_eventlog                   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_journal                    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_json                       = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_rootwrap_daemon            = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_stderr                     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] use_syslog                     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vcpu_pin_set                   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plugging_is_fatal          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plugging_timeout           = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] virt_mkfs                      = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] volume_usage_poll_interval     = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] watch_log_file                 = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] web                            = /usr/share/spice-html5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_concurrency.disable_process_locking = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.auth_strategy              = keystone {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.compute_link_prefix        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.dhcp_domain                = novalocal {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.enable_instance_password   = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.glance_link_prefix         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.instance_list_per_project_cells = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.list_records_by_skipping_down_cells = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.local_metadata_per_cell    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.max_limit                  = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.metadata_cache_expiration  = 15 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.neutron_default_tenant_id  = default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.use_forwarded_for          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.use_neutron_default_nets   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_dynamic_targets = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_jsonfile_path   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.backend_argument         = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.config_prefix            = cache.oslo {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.dead_timeout             = 60.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.debug_cache_backend      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.enable_retry_client      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.enable_socket_keepalive  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.enabled                  = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.expiration_time          = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.hashclient_retry_attempts = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_dead_retry      = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_password        =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_sasl_enabled    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.memcache_username        =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.proxies                  = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.retry_attempts           = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.retry_delay              = 0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.socket_keepalive_count   = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.socket_keepalive_idle    = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.socket_keepalive_interval = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.tls_allowed_ciphers      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.tls_cafile               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.tls_certfile             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.tls_enabled              = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cache.tls_keyfile              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.auth_section            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.auth_type               = password {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.cafile                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.certfile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.collect_timing          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.cross_az_attach         = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.debug                   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.endpoint_template       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.http_retries            = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.insecure                = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.keyfile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.os_region_name          = RegionOne {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.split_loggers           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cinder.timeout                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.cpu_dedicated_set      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.cpu_shared_set         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.image_type_exclude_list = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.resource_provider_association_refresh = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.shutdown_retry_interval = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] conductor.workers              = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] console.allowed_origins        = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] console.ssl_ciphers            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] console.ssl_minimum_version    = default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] consoleauth.token_ttl          = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.cafile                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.certfile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.collect_timing          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.connect_retries         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.connect_retry_delay     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.endpoint_override       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.insecure                = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.keyfile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.max_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.min_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.region_name             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.service_name            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.service_type            = accelerator {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.split_loggers           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.status_code_retries     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.timeout                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] cyborg.version                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.backend               = sqlalchemy {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.connection            = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.connection_debug      = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.connection_parameters =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.connection_recycle_time = 3600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.connection_trace      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.db_inc_retry_interval = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.db_max_retries        = 20 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.db_max_retry_interval = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.db_retry_interval     = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.max_overflow          = 50 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.max_pool_size         = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.max_retries           = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.mysql_wsrep_sync_wait = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.pool_timeout          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.retry_interval        = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.slave_connection      = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] database.sqlite_synchronous    = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.backend           = sqlalchemy {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.connection        = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.connection_debug  = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.connection_parameters =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.connection_recycle_time = 3600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.connection_trace  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.db_inc_retry_interval = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.db_max_retries    = 20 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.db_max_retry_interval = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.db_retry_interval = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.max_overflow      = 50 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.max_pool_size     = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.max_retries       = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.pool_timeout      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.retry_interval    = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.slave_connection  = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] api_database.sqlite_synchronous = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] devices.enabled_mdev_types     = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ephemeral_storage_encryption.enabled = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.api_servers             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.cafile                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.certfile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.collect_timing          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.connect_retries         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.connect_retry_delay     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.debug                   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.default_trusted_certificate_ids = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.enable_certificate_validation = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.enable_rbd_download     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.endpoint_override       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.insecure                = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.keyfile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.max_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.min_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.num_retries             = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.rbd_ceph_conf           =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.rbd_connect_timeout     = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.rbd_pool                =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.rbd_user                =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.region_name             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.service_name            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.service_type            = image {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.split_loggers           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.status_code_retries     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.timeout                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.verify_glance_signatures = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] glance.version                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] guestfs.debug                  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.config_drive_cdrom      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.config_drive_inject_password = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.enable_remotefx         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.instances_path_share    =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.limit_cpu_features      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.use_multipath_io        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.vswitch_name            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] mks.enabled                    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.manager_interval   = 2400 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.precache_concurrency = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.remove_unused_base_images = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] image_cache.subdirectory_name  = _base {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.api_max_retries         = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.api_retry_interval      = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.auth_section            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.auth_type               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.cafile                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.certfile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.collect_timing          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.conductor_group         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.connect_retries         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.connect_retry_delay     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.endpoint_override       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.insecure                = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.keyfile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.max_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.min_version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.peer_list               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.region_name             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.serial_console_state_timeout = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.service_name            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.service_type            = baremetal {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.split_loggers           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.status_code_retries     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.timeout                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ironic.version                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] key_manager.fixed_key          = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.barbican_api_version  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.barbican_endpoint     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.barbican_endpoint_type = public {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.barbican_region_name  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.cafile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.certfile              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.collect_timing        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.insecure              = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.keyfile               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.number_of_retries     = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.retry_delay           = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.send_service_user_token = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.split_loggers         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.timeout               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.verify_ssl            = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican.verify_ssl_path       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.auth_section = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.auth_type = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.cafile   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.certfile = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.collect_timing = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.insecure = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.keyfile  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.split_loggers = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] barbican_service_user.timeout  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.approle_role_id          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.approle_secret_id        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.cafile                   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.certfile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.collect_timing           = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.insecure                 = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.keyfile                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.kv_mountpoint            = secret {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.kv_path                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.kv_version               = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.namespace                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.root_token_id            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.split_loggers            = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.ssl_ca_crt_file          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.timeout                  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.use_ssl                  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.auth_section          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.auth_type             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.cafile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.certfile              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.collect_timing        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.connect_retries       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.connect_retry_delay   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.endpoint_override     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.insecure              = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.keyfile               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.max_version           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.min_version           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.region_name           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.service_name          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.service_type          = identity {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.split_loggers         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.status_code_retries   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.timeout               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] keystone.version               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.connection_uri         =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_mode               = custom {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: WARNING oslo_config.cfg [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_power_governor_high = performance {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_power_management   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.device_detach_attempts = 8 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.device_detach_timeout  = 20 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.disk_cachemodes        = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.disk_prefix            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.enabled_perf_events    = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.file_backed_memory     = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.gid_maps               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.hw_disk_discard        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.hw_machine_type        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_rbd_pool        = rbd {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_type            = default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.images_volume_group    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.inject_key             = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.inject_partition       = -2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.inject_password        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.iscsi_iface            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.iser_use_multipath     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_downtime = 500 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_inbound_addr = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_scheme  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_timeout_action = abort {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_tunnelled = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: WARNING oslo_config.cfg [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 25 17:42:54 user nova-compute[74739]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 25 17:42:54 user nova-compute[74739]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 25 17:42:54 user nova-compute[74739]: and ``live_migration_inbound_addr`` respectively.
Oct 25 17:42:54 user nova-compute[74739]: ).  Its value may be silently ignored in the future.
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.live_migration_with_native_tls = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.max_queues             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.nfs_mount_options      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_pcie_ports         = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.pmem_namespaces        = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.quobyte_client_cfg     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rbd_secret_uuid        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rbd_user               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rescue_image_id        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rescue_kernel_id       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.rx_queue_size          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.smbfs_mount_options    =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.snapshot_compression   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.snapshot_image_format  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.sparse_logical_volumes = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.swtpm_enabled          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.swtpm_group            = tss {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.swtpm_user             = tss {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.sysinfo_serial         = unique {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.tb_cache_size          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.tx_queue_size          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.uid_maps               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.use_virtio_for_bridges = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.virt_type              = kvm {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.volume_clear           = zero {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.volume_clear_size      = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.volume_use_multipath   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_cache_path   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.auth_section           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.auth_type              = password {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.cafile                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.certfile               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.collect_timing         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.connect_retries        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.connect_retry_delay    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.default_floating_pool  = public {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.endpoint_override      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.extension_sync_interval = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.http_retries           = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.insecure               = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.keyfile                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.max_version            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.min_version            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.ovs_bridge             = br-int {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.physnets               = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.region_name            = RegionOne {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.service_metadata_proxy = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.service_name           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.service_type           = network {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.split_loggers          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.status_code_retries    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.timeout                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] neutron.version                = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] notifications.bdms_in_notifications = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] notifications.default_level    = INFO {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] notifications.notification_format = unversioned {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] notifications.notify_on_state_change = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] pci.alias                      = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] pci.device_spec                = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] pci.report_in_placement        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.auth_section         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.auth_type            = password {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.cafile               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.certfile             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.collect_timing       = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.connect_retries      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.connect_retry_delay  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.default_domain_id    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.default_domain_name  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.domain_id            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.domain_name          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.endpoint_override    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.insecure             = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.keyfile              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.max_version          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.min_version          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.password             = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.project_domain_id    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.project_domain_name  = Default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.project_id           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.project_name         = service {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.region_name          = RegionOne {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.service_name         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.service_type         = placement {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.split_loggers        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.status_code_retries  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.system_scope         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.timeout              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.trust_id             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.user_domain_id       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.user_domain_name     = Default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.user_id              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.username             = placement {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] placement.version              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.cores                    = 20 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.count_usage_from_placement = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.injected_file_content_bytes = 10240 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.injected_file_path_length = 255 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.injected_files           = 5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.instances                = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.key_pairs                = 100 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.metadata_items           = 128 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.ram                      = 51200 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.recheck_quota            = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.server_group_members     = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] quota.server_groups            = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rdp.enabled                    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.image_metadata_prefilter = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.max_attempts         = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.max_placement_results = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] scheduler.workers              = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.host_subset_size = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.isolated_hosts = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.isolated_images = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.pci_in_placement = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.track_instance_changes = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metrics.required               = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metrics.weight_multiplier      = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] metrics.weight_setting         = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.enabled         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.port_range      = 10000:20000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] serial_console.serialproxy_port = 6083 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.auth_section      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.auth_type         = password {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.cafile            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.certfile          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.collect_timing    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.insecure          = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.keyfile           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.send_service_user_token = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.split_loggers     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] service_user.timeout           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.agent_enabled            = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.enabled                  = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.html5proxy_port          = 6082 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.image_compression        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.jpeg_compression         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.playback_compression     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.server_listen            = 127.0.0.1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.streaming_mode           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] spice.zlib_compression         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] upgrade_levels.baseapi         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] upgrade_levels.cert            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] upgrade_levels.compute         = auto {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] upgrade_levels.conductor       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] upgrade_levels.scheduler       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.cafile = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.certfile = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.insecure = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vendordata_dynamic_auth.timeout = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.api_retry_count         = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.ca_file                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.cache_prefix            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.cluster_name            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.connection_pool_size    = 10 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.console_delay_seconds   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.datastore_regex         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.host_ip                 = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.host_password           = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.host_port               = 443 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.host_username           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.insecure                = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.integration_bridge      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.maximum_objects         = 100 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.pbm_default_policy      = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.pbm_enabled             = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.pbm_wsdl_location       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.serial_port_proxy_uri   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.serial_port_service_uri = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.task_poll_interval      = 0.5 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.use_linked_clone        = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.vnc_keymap              = en-us {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.vnc_port                = 5900 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vmware.vnc_port_total          = 10000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.auth_schemes               = ['none'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.enabled                    = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.novncproxy_port            = 6080 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.vencrypt_ca_certs          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.vencrypt_client_cert       = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vnc.vencrypt_client_key        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.disable_rootwrap   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.enable_numa_live_migration = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.libvirt_disable_apic = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.client_socket_timeout     = 900 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.default_pool_size         = 1000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.keep_alive                = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.max_header_line           = 16384 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.ssl_ca_file               = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.ssl_cert_file             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.ssl_key_file              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.tcp_keepidle              = 600 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] zvm.ca_file                    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] zvm.cloud_connector_url        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] zvm.reachable_timeout          = 300 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.enforce_new_defaults = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.enforce_scope      = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.policy_default_rule = default {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.connection_string     = messaging:// {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.enabled               = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.es_doc_type           = notification {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.es_scroll_size        = 10000 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.es_scroll_time        = 2m {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.filter_error_trace    = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.hmac_keys             = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.sentinel_service_name = mymaster {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.socket_timeout        = 0.1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.trace_requests        = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler.trace_sqlalchemy      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler_jaeger.process_tags   = {} {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler_jaeger.service_name_prefix = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] profiler_otlp.service_name_prefix = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] remote_debug.host              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] remote_debug.port              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_notifications.retry = -1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.auth_section        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.auth_type           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.cafile              = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.certfile            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.collect_timing      = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.connect_retries     = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.connect_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.endpoint_id         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.endpoint_override   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.insecure            = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.keyfile             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.max_version         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.min_version         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.region_name         = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.service_name        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.service_type        = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.split_loggers       = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.status_code_retries = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.status_code_retry_delay = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.timeout             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.valid_interfaces    = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_limit.version             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_reports.file_event_handler = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] oslo_reports.log_dir           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.group  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] vif_plug_ovs_privileged.user   = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.isolate_vif         = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] os_brick.lock_path             = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.capabilities   = [21] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.group          = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.helper_command = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] privsep_osbrick.user           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.group           = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.helper_command  = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] nova_sys_admin.user            = None {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG oslo_service.service [None req-990cfd0e-8c2c-459c-a7f3-747b5c5c997e None None] ******************************************************************************** {{(pid=74739) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 25 17:42:54 user nova-compute[74739]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Connecting to libvirt: qemu:///system {{(pid=74739) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd2ee166590> {{(pid=74739) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 25 17:42:54 user nova-compute[74739]: libvirt:  error : internal error: could not initialize domain event timer
Oct 25 17:42:54 user nova-compute[74739]: WARNING nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd2ee166590> {{(pid=74739) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Starting native event thread {{(pid=74739) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Starting green dispatch thread {{(pid=74739) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Starting connection event dispatch thread {{(pid=74739) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 25 17:42:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Connection event '1' reason 'None'
Oct 25 17:42:54 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 17:42:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.mount [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Initialising _HostMountState generation 0 {{(pid=74739) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 25 17:43:01 user nova-compute[74739]: INFO nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host capabilities <capabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <host>
Oct 25 17:43:01 user nova-compute[74739]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 25 17:43:01 user nova-compute[74739]:     <cpu>
Oct 25 17:43:01 user nova-compute[74739]:       <arch>x86_64</arch>
Oct 25 17:43:01 user nova-compute[74739]:       <model>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <microcode version='1070'/>
Oct 25 17:43:01 user nova-compute[74739]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='osxsave'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='invtsc'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='rsba'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature name='skip-l1dfl-vmentry'/>
Oct 25 17:43:01 user nova-compute[74739]:       <pages unit='KiB' size='4'/>
Oct 25 17:43:01 user nova-compute[74739]:       <pages unit='KiB' size='2048'/>
Oct 25 17:43:01 user nova-compute[74739]:     </cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <power_management>
Oct 25 17:43:01 user nova-compute[74739]:       <suspend_mem/>
Oct 25 17:43:01 user nova-compute[74739]:       <suspend_disk/>
Oct 25 17:43:01 user nova-compute[74739]:       <suspend_hybrid/>
Oct 25 17:43:01 user nova-compute[74739]:     </power_management>
Oct 25 17:43:01 user nova-compute[74739]:     <iommu support='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <migration_features>
Oct 25 17:43:01 user nova-compute[74739]:       <live/>
Oct 25 17:43:01 user nova-compute[74739]:       <uri_transports>
Oct 25 17:43:01 user nova-compute[74739]:         <uri_transport>tcp</uri_transport>
Oct 25 17:43:01 user nova-compute[74739]:         <uri_transport>rdma</uri_transport>
Oct 25 17:43:01 user nova-compute[74739]:       </uri_transports>
Oct 25 17:43:01 user nova-compute[74739]:     </migration_features>
Oct 25 17:43:01 user nova-compute[74739]:     <topology>
Oct 25 17:43:01 user nova-compute[74739]:       <cells num='2'>
Oct 25 17:43:01 user nova-compute[74739]:         <cell id='0'>
Oct 25 17:43:01 user nova-compute[74739]:           <memory unit='KiB'>8140616</memory>
Oct 25 17:43:01 user nova-compute[74739]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 25 17:43:01 user nova-compute[74739]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 17:43:01 user nova-compute[74739]:           <distances>
Oct 25 17:43:01 user nova-compute[74739]:             <sibling id='0' value='10'/>
Oct 25 17:43:01 user nova-compute[74739]:             <sibling id='1' value='20'/>
Oct 25 17:43:01 user nova-compute[74739]:           </distances>
Oct 25 17:43:01 user nova-compute[74739]:           <cpus num='6'>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 25 17:43:01 user nova-compute[74739]:           </cpus>
Oct 25 17:43:01 user nova-compute[74739]:         </cell>
Oct 25 17:43:01 user nova-compute[74739]:         <cell id='1'>
Oct 25 17:43:01 user nova-compute[74739]:           <memory unit='KiB'>8255068</memory>
Oct 25 17:43:01 user nova-compute[74739]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 25 17:43:01 user nova-compute[74739]:           <pages unit='KiB' size='2048'>0</pages>
Oct 25 17:43:01 user nova-compute[74739]:           <distances>
Oct 25 17:43:01 user nova-compute[74739]:             <sibling id='0' value='20'/>
Oct 25 17:43:01 user nova-compute[74739]:             <sibling id='1' value='10'/>
Oct 25 17:43:01 user nova-compute[74739]:           </distances>
Oct 25 17:43:01 user nova-compute[74739]:           <cpus num='6'>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 25 17:43:01 user nova-compute[74739]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 25 17:43:01 user nova-compute[74739]:           </cpus>
Oct 25 17:43:01 user nova-compute[74739]:         </cell>
Oct 25 17:43:01 user nova-compute[74739]:       </cells>
Oct 25 17:43:01 user nova-compute[74739]:     </topology>
Oct 25 17:43:01 user nova-compute[74739]:     <cache>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 25 17:43:01 user nova-compute[74739]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 25 17:43:01 user nova-compute[74739]:     </cache>
Oct 25 17:43:01 user nova-compute[74739]:     <secmodel>
Oct 25 17:43:01 user nova-compute[74739]:       <model>apparmor</model>
Oct 25 17:43:01 user nova-compute[74739]:       <doi>0</doi>
Oct 25 17:43:01 user nova-compute[74739]:     </secmodel>
Oct 25 17:43:01 user nova-compute[74739]:     <secmodel>
Oct 25 17:43:01 user nova-compute[74739]:       <model>dac</model>
Oct 25 17:43:01 user nova-compute[74739]:       <doi>0</doi>
Oct 25 17:43:01 user nova-compute[74739]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 25 17:43:01 user nova-compute[74739]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 25 17:43:01 user nova-compute[74739]:     </secmodel>
Oct 25 17:43:01 user nova-compute[74739]:   </host>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='alpha'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>clipper</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='armv6l'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>spitz</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>nuri</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>kzm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>z2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>tosa</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n810</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>terrier</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>midway</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>microbit</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>verdex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>highbank</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>akita</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>connex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>collie</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='armv7l'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>spitz</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>nuri</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>kzm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>z2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>tosa</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n810</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>terrier</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>midway</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>microbit</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>verdex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>highbank</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>akita</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>connex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>collie</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='aarch64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>integratorcp</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>borzoi</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>spitz</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>nuri</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-b1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatileab</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>kzm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>musca-a</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>smdkc210</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>z2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>tosa</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>sabrelite</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-eb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n810</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>n800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>versatilepb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>terrier</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mainstone</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>midway</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>musicpal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>microbit</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cubieboard</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>verdex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduino2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>raspi3b</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>raspi2b</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>cheetah</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>highbank</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>akita</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>connex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>collie</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>raspi0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <acpi default='on' toggle='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='cris'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='i686'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>isapc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>microvm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='kvm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <pae/>
Oct 25 17:43:01 user nova-compute[74739]:       <nonpae/>
Oct 25 17:43:01 user nova-compute[74739]:       <acpi default='on' toggle='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:       <apic default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='m68k'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>an5206</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>q800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>next-cube</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='microblaze'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='microblazeel'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='mips'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>malta</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='mipsel'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>malta</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='mips64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>malta</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>pica61</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>magnum</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='mips64el'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>malta</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mipssim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>pica61</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>magnum</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='16'>boston</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='ppc'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mac99</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>40p</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>taihu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='ppc64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>taihu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>40p</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mac99</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='ppc64le'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>taihu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ppce500</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>40p</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>pegasos2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>bamboo</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>g3beige</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>mac99</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sam460ex</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>ref405ep</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2048'>powernv8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='riscv32'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='8'>spike</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>opentitan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='8'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='riscv64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='8'>spike</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='5'>sifive_u</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>shakti_c</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sifive_e</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='8'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='s390x'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='sh4'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>shix</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>r2d</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='sh4eb'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>shix</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>r2d</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='sparc'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>SS-5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>SS-20</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>LX</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>SS-4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>SS-10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>Voyager</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='sparc64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sun4u</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>niagara</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>sun4v</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='x86_64'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>64</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>x-remote</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='1'>isapc</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>microvm</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='kvm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <acpi default='on' toggle='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:       <apic default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='xtensa'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>sim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>kc705</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ml605</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx200</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx60</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]:   <guest>
Oct 25 17:43:01 user nova-compute[74739]:     <os_type>hvm</os_type>
Oct 25 17:43:01 user nova-compute[74739]:     <arch name='xtensaeb'>
Oct 25 17:43:01 user nova-compute[74739]:       <wordsize>32</wordsize>
Oct 25 17:43:01 user nova-compute[74739]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='4'>sim</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>kc705</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ml605</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>virt</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx200</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>lx60</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 25 17:43:01 user nova-compute[74739]:       <domain type='qemu'/>
Oct 25 17:43:01 user nova-compute[74739]:     </arch>
Oct 25 17:43:01 user nova-compute[74739]:     <features>
Oct 25 17:43:01 user nova-compute[74739]:       <cpuselection/>
Oct 25 17:43:01 user nova-compute[74739]:       <deviceboot/>
Oct 25 17:43:01 user nova-compute[74739]:       <disksnapshot default='on' toggle='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     </features>
Oct 25 17:43:01 user nova-compute[74739]:   </guest>
Oct 25 17:43:01 user nova-compute[74739]: </capabilities>
Oct 25 17:43:01 user nova-compute[74739]: 
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-q35-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>i686</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='288'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'/>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='lm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-i440fx-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>i686</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='255'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'/>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='lm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ide</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-i440fx-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>i686</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='255'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'/>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='lm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ide</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-i386</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-q35-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>i686</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='288'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'/>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='lm'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-q35-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>x86_64</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='288'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>efi</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='invtsc'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='rsba'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-i440fx-6.2</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>x86_64</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='255'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>efi</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='invtsc'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='rsba'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ide</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-i440fx-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>x86_64</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='255'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>efi</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='invtsc'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='rsba'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ide</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 25 17:43:01 user nova-compute[74739]: <domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 25 17:43:01 user nova-compute[74739]:   <domain>kvm</domain>
Oct 25 17:43:01 user nova-compute[74739]:   <machine>pc-q35-jammy</machine>
Oct 25 17:43:01 user nova-compute[74739]:   <arch>x86_64</arch>
Oct 25 17:43:01 user nova-compute[74739]:   <vcpu max='288'/>
Oct 25 17:43:01 user nova-compute[74739]:   <iothreads supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:   <os supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='firmware'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>efi</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:     <loader supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>rom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pflash</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='readonly'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='secure'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>yes</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>no</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </loader>
Oct 25 17:43:01 user nova-compute[74739]:   </os>
Oct 25 17:43:01 user nova-compute[74739]:   <cpu>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-passthrough' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='hostPassthroughMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='maximum' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='maximumMigratable'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>on</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>off</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='host-model' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <vendor>Intel</vendor>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ss'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='vmx'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pcid'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='hypervisor'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arat'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='tsc_adjust'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='umip'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='md-clear'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='arch-capabilities'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='invtsc'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibpb'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='ibrs'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-stibp'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='amd-ssbd'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='rsba'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='require' name='pschange-mc-no'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='erms'/>
Oct 25 17:43:01 user nova-compute[74739]:       <feature policy='disable' name='xsaveopt'/>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:     <mode name='custom' supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>qemu64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>qemu32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>phenom</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>pentium</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>n270</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm64</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>kvm32</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>coreduo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>core2duo</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>athlon</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Westmere</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Snowridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Skylake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>SandyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Penryn</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G5</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G4</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G3</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Opteron_G2</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Opteron_G1</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>IvyBridge</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Icelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Haswell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Rome</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-Milan</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC-IBPB</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>EPYC</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Dhyana</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cooperlake</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>Conroe</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Cascadelake-Server</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-noTSX</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell-IBRS</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='no'>Broadwell</model>
Oct 25 17:43:01 user nova-compute[74739]:       <model usable='yes'>486</model>
Oct 25 17:43:01 user nova-compute[74739]:     </mode>
Oct 25 17:43:01 user nova-compute[74739]:   </cpu>
Oct 25 17:43:01 user nova-compute[74739]:   <memoryBacking supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:     <enum name='sourceType'>
Oct 25 17:43:01 user nova-compute[74739]:       <value>file</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>anonymous</value>
Oct 25 17:43:01 user nova-compute[74739]:       <value>memfd</value>
Oct 25 17:43:01 user nova-compute[74739]:     </enum>
Oct 25 17:43:01 user nova-compute[74739]:   </memoryBacking>
Oct 25 17:43:01 user nova-compute[74739]:   <devices>
Oct 25 17:43:01 user nova-compute[74739]:     <disk supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='diskDevice'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>disk</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cdrom</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>floppy</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>lun</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='bus'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>fdc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sata</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </disk>
Oct 25 17:43:01 user nova-compute[74739]:     <graphics supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='type'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>sdl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vnc</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>spice</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egl-headless</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </graphics>
Oct 25 17:43:01 user nova-compute[74739]:     <video supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='modelType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>cirrus</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>vmvga</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>qxl</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>none</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>bochs</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>ramfb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </video>
Oct 25 17:43:01 user nova-compute[74739]:     <hostdev supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='mode'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>subsystem</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='startupPolicy'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>default</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>mandatory</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>requisite</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>optional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='subsysType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>usb</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>pci</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>scsi</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='capsType'/>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='pciBackend'/>
Oct 25 17:43:01 user nova-compute[74739]:     </hostdev>
Oct 25 17:43:01 user nova-compute[74739]:     <rng supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtio-non-transitional</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>random</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>egd</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>builtin</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </rng>
Oct 25 17:43:01 user nova-compute[74739]:     <filesystem supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='driverType'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>path</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>handle</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>virtiofs</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </filesystem>
Oct 25 17:43:01 user nova-compute[74739]:     <tpm supported='yes'>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='model'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-tis</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>tpm-crb</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:       <enum name='backendModel'>
Oct 25 17:43:01 user nova-compute[74739]:         <value>passthrough</value>
Oct 25 17:43:01 user nova-compute[74739]:         <value>emulator</value>
Oct 25 17:43:01 user nova-compute[74739]:       </enum>
Oct 25 17:43:01 user nova-compute[74739]:     </tpm>
Oct 25 17:43:01 user nova-compute[74739]:   </devices>
Oct 25 17:43:01 user nova-compute[74739]:   <features>
Oct 25 17:43:01 user nova-compute[74739]:     <gic supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:     <vmcoreinfo supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <genid supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backingStoreInput supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <backup supported='yes'/>
Oct 25 17:43:01 user nova-compute[74739]:     <sev supported='no'/>
Oct 25 17:43:01 user nova-compute[74739]:   </features>
Oct 25 17:43:01 user nova-compute[74739]: </domainCapabilities>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74739) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74739) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Checking secure boot support for host arch (x86_64) {{(pid=74739) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 25 17:43:01 user nova-compute[74739]: INFO nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Secure Boot support detected
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] cpu compare xml: <cpu match="exact">
Oct 25 17:43:01 user nova-compute[74739]:   <model>Nehalem</model>
Oct 25 17:43:01 user nova-compute[74739]: </cpu>
Oct 25 17:43:01 user nova-compute[74739]:  {{(pid=74739) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 25 17:43:01 user nova-compute[74739]: INFO nova.virt.node [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Generated node identity 3998dc2a-c940-46be-8c01-65f11782a00e
Oct 25 17:43:01 user nova-compute[74739]: INFO nova.virt.node [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Wrote node identity 3998dc2a-c940-46be-8c01-65f11782a00e to /opt/stack/data/nova/compute_id
Oct 25 17:43:01 user nova-compute[74739]: WARNING nova.compute.manager [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Compute nodes ['3998dc2a-c940-46be-8c01-65f11782a00e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 25 17:43:01 user nova-compute[74739]: INFO nova.compute.manager [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 25 17:43:01 user nova-compute[74739]: WARNING nova.compute.manager [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 25 17:43:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:43:01 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:43:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:43:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Hypervisor/Node resource view: name=user free_ram=10956MB free_disk=26.150775909423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:43:02 user nova-compute[74739]: WARNING nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] No compute node record for user:3998dc2a-c940-46be-8c01-65f11782a00e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3998dc2a-c940-46be-8c01-65f11782a00e could not be found.
Oct 25 17:43:02 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Compute node record created for user:user with uuid: 3998dc2a-c940-46be-8c01-65f11782a00e
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:43:02 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] [req-a3c505df-79ac-42b2-ac5b-a0759e50e22e] Created resource provider record via placement API for resource provider with UUID 3998dc2a-c940-46be-8c01-65f11782a00e and name user.
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74739) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 25 17:43:02 user nova-compute[74739]: INFO nova.virt.libvirt.host [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] kernel doesn't support AMD SEV
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Libvirt baseline CPU <cpu>
Oct 25 17:43:02 user nova-compute[74739]:   <arch>x86_64</arch>
Oct 25 17:43:02 user nova-compute[74739]:   <model>Nehalem</model>
Oct 25 17:43:02 user nova-compute[74739]:   <vendor>Intel</vendor>
Oct 25 17:43:02 user nova-compute[74739]:   <topology sockets="6" cores="1" threads="1"/>
Oct 25 17:43:02 user nova-compute[74739]: </cpu>
Oct 25 17:43:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Updated inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Updating resource provider 3998dc2a-c940-46be-8c01-65f11782a00e generation from 0 to 1 during operation: update_inventory {{(pid=74739) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Updating resource provider 3998dc2a-c940-46be-8c01-65f11782a00e generation from 1 to 2 during operation: update_traits {{(pid=74739) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.service [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Creating RPC server for service compute {{(pid=74739) start /opt/stack/nova/nova/service.py:182}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.service [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] Join ServiceGroup membership for this service compute {{(pid=74739) start /opt/stack/nova/nova/service.py:199}}
Oct 25 17:43:02 user nova-compute[74739]: DEBUG nova.servicegroup.drivers.db [None req-dddac0ff-03b2-4f84-9d9d-4927d815d22b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74739) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 25 17:43:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:43:53 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:43:54 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:43:54 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=10353MB free_disk=26.055103302001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:43:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:44:55 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:44:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:44:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=10392MB free_disk=26.13827133178711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:44:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:45:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:45:55 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:45:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:45:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=10269MB free_disk=25.889366149902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:45:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:45:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:45:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:46:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:46:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:46:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9738MB free_disk=25.903236389160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:46:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:46:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:15 user nova-compute[74739]: INFO nova.compute.claims [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Claim successful on node user
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Creating image(s)
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "/opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "/opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "/opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:16 user nova-compute[74739]: DEBUG nova.policy [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9062c96920c34828b8a43f2460f2e0d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa0fe25d51d457295b528c926271159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG nova.virt.images [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] fa4bc56a-56a0-4e07-993a-3918bd5a9269 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.part /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.part /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.converted" returned: 0 in 0.303s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.827s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:17 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0t93yzbw/privsep.sock']
Oct 25 17:47:17 user sudo[83980]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0t93yzbw/privsep.sock
Oct 25 17:47:17 user sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 17:47:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Successfully created port: c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:19 user sudo[83980]: pam_unix(sudo:session): session closed for user root
Oct 25 17:47:19 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Spawned new privsep daemon via rootwrap
Oct 25 17:47:19 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 17:47:19 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 17:47:19 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 25 17:47:19 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83988
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk 1073741824" returned: 0 in 0.051s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Cannot resize image /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Ensure instance console log exists: /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Successfully updated port: c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquired lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-changed-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Refreshing instance network info cache due to event network-changed-c16be41b-c787-476d-932d-62a8dcc0d188. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] Acquiring lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating instance_info_cache with network_info: [{"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Releasing lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Instance network_info: |[{"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] Acquired lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.neutron [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Refreshing network info cache for port c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Start _get_guest_xml network_info=[{"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1616510399',display_name='tempest-DeleteServersTestJSON-server-1616510399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1616510399',id=1,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa0fe25d51d457295b528c926271159',ramdisk_id='',reservation_id='r-k5d6hovw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-881344941',owner_user_name='tempest-DeleteServersTestJSON-881344941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:16Z,user_data=None,user_id='9062c96920c34828b8a43f2460f2e0d5',uuid=78ae4728-74df-4d51-b3ad-c550f2e95850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converting VIF {"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.objects.instance [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lazy-loading 'pci_devices' on Instance uuid 78ae4728-74df-4d51-b3ad-c550f2e95850 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:21 user nova-compute[74739]:   <uuid>78ae4728-74df-4d51-b3ad-c550f2e95850</uuid>
Oct 25 17:47:21 user nova-compute[74739]:   <name>instance-00000001</name>
Oct 25 17:47:21 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:21 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:21 user nova-compute[74739]:   <metadata>
Oct 25 17:47:21 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:21 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:name>tempest-DeleteServersTestJSON-server-1616510399</nova:name>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:21</nova:creationTime>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:21 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:21 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:user uuid="9062c96920c34828b8a43f2460f2e0d5">tempest-DeleteServersTestJSON-881344941-project-member</nova:user>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:project uuid="7aa0fe25d51d457295b528c926271159">tempest-DeleteServersTestJSON-881344941</nova:project>
Oct 25 17:47:21 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:21 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:21 user nova-compute[74739]:         <nova:port uuid="c16be41b-c787-476d-932d-62a8dcc0d188">
Oct 25 17:47:21 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 17:47:21 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:21 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:21 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:21 user nova-compute[74739]:   </metadata>
Oct 25 17:47:21 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:21 user nova-compute[74739]:     <system>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="serial">78ae4728-74df-4d51-b3ad-c550f2e95850</entry>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="uuid">78ae4728-74df-4d51-b3ad-c550f2e95850</entry>
Oct 25 17:47:21 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:21 user nova-compute[74739]:     </system>
Oct 25 17:47:21 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:21 user nova-compute[74739]:   <os>
Oct 25 17:47:21 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:21 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:21 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:21 user nova-compute[74739]:   </os>
Oct 25 17:47:21 user nova-compute[74739]:   <features>
Oct 25 17:47:21 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:21 user nova-compute[74739]:     <apic/>
Oct 25 17:47:21 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:21 user nova-compute[74739]:   </features>
Oct 25 17:47:21 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:21 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:21 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:21 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:21 user nova-compute[74739]:   </clock>
Oct 25 17:47:21 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:21 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:21 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:21 user nova-compute[74739]:   </cpu>
Oct 25 17:47:21 user nova-compute[74739]:   <devices>
Oct 25 17:47:21 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:21 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:21 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk"/>
Oct 25 17:47:21 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:21 user nova-compute[74739]:     </disk>
Oct 25 17:47:21 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:21 user nova-compute[74739]:       <mac address="fa:16:3e:d0:fb:f7"/>
Oct 25 17:47:21 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:21 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:21 user nova-compute[74739]:       <target dev="tapc16be41b-c7"/>
Oct 25 17:47:21 user nova-compute[74739]:     </interface>
Oct 25 17:47:21 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:21 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/console.log" append="off"/>
Oct 25 17:47:21 user nova-compute[74739]:     </serial>
Oct 25 17:47:21 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:21 user nova-compute[74739]:     <video>
Oct 25 17:47:21 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:21 user nova-compute[74739]:     </video>
Oct 25 17:47:21 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:21 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:21 user nova-compute[74739]:     </rng>
Oct 25 17:47:21 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:21 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:21 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:21 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:21 user nova-compute[74739]:   </devices>
Oct 25 17:47:21 user nova-compute[74739]: </domain>
Oct 25 17:47:21 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1616510399',display_name='tempest-DeleteServersTestJSON-server-1616510399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1616510399',id=1,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa0fe25d51d457295b528c926271159',ramdisk_id='',reservation_id='r-k5d6hovw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-881344941',owner_user_name='tempest-DeleteServersTestJSON-881344941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:16Z,user_data=None,user_id='9062c96920c34828b8a43f2460f2e0d5',uuid=78ae4728-74df-4d51-b3ad-c550f2e95850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converting VIF {"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG os_vif [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Created schema index Interface.name {{(pid=74739) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Created schema index Port.name {{(pid=74739) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Created schema index Bridge.name {{(pid=74739) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [POLLOUT] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b198d9f-0707-5b62-9eb5-3111dd2e5774', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:21 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmplcduxqil/privsep.sock']
Oct 25 17:47:21 user sudo[84009]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmplcduxqil/privsep.sock
Oct 25 17:47:21 user sudo[84009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:21 user nova-compute[74739]: INFO nova.compute.claims [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Claim successful on node user
Oct 25 17:47:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updated VIF entry in instance network info cache for port c16be41b-c787-476d-932d-62a8dcc0d188. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating instance_info_cache with network_info: [{"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9076dc5a-0967-4238-8a20-20bf9f20084e req-d815bdb6-67d6-4471-a2ea-65736fecb3fa service nova] Releasing lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.policy [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964d6de8a5b7400ea3a45d666a499632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed00ba170e845c8ad57fe410d8388b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Creating image(s)
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "/opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk 1073741824" returned: 0 in 0.046s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.162s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:23 user sudo[84009]: pam_unix(sudo:session): session closed for user root
Oct 25 17:47:23 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Spawned new privsep daemon via rootwrap
Oct 25 17:47:23 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 17:47:23 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 17:47:23 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 25 17:47:23 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84019
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Cannot resize image /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Ensure instance console log exists: /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc16be41b-c7, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc16be41b-c7, col_values=(('qos', UUID('b5a09ed6-8da3-410d-89f6-f7b9d0ba294e')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc16be41b-c7, col_values=(('external_ids', {'iface-id': 'c16be41b-c787-476d-932d-62a8dcc0d188', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:fb:f7', 'vm-uuid': '78ae4728-74df-4d51-b3ad-c550f2e95850'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:23 user nova-compute[74739]: INFO os_vif [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7')
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] No VIF found with MAC fa:16:3e:d0:fb:f7, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Successfully created port: a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:26 user nova-compute[74739]: INFO nova.compute.claims [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Claim successful on node user
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.013s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:26 user nova-compute[74739]: INFO nova.compute.claims [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Claim successful on node user
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Instance spawned successfully.
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Took 11.28 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.compute.manager [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Took 12.27 seconds to build instance.
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Creating image(s)
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-93496cdd-24ec-491b-870e-e3add110e78c tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.572s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.policy [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e140ed4e3e2f4d5abc2e08e1400715de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2a1dd2b0954a74be154b7082170334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.163s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.compute.claims [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Claim successful on node user
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.275s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Successfully updated port: a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-changed-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Refreshing instance network info cache due to event network-changed-a8bd265f-f516-4bd8-93bd-4c9ac13fa341. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.network.neutron [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Refreshing network info cache for port a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.278s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.network.neutron [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk 1073741824" returned: 0 in 0.060s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.policy [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be7a94af5cae47709995a2d16346740c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9bfb1966da34253bbe550d1dbf97979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Creating image(s)
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.252s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.266s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Cannot resize image /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Ensure instance console log exists: /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.280s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Creating image(s)
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.213s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.policy [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ace8d9977bb4a0f869bec3b8e79e2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1d84fb43034e9d9f6cf85063763000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk 1073741824" returned: 0 in 0.301s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.632s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-355763f1-ab59-4941-a6a2-55b6462bd7a4 req-636977ee-1bdd-4432-b36a-25f5d5b1f2e6 service nova] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:28 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.276s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Cannot resize image /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Ensure instance console log exists: /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk 1073741824" returned: 0 in 0.069s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Successfully created port: 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.237s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Cannot resize image /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Ensure instance console log exists: /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance network_info: |[{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Start _get_guest_xml network_info=[{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681183607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681183607',id=2,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-7puwktqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:22Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=c463c6be-cd71-4bd9-9b83-7485d5ff9afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:30 user nova-compute[74739]:   <uuid>c463c6be-cd71-4bd9-9b83-7485d5ff9afd</uuid>
Oct 25 17:47:30 user nova-compute[74739]:   <name>instance-00000002</name>
Oct 25 17:47:30 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:30 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:30 user nova-compute[74739]:   <metadata>
Oct 25 17:47:30 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:30 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-681183607</nova:name>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:30</nova:creationTime>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:30 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:30 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 17:47:30 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:30 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:30 user nova-compute[74739]:         <nova:port uuid="a8bd265f-f516-4bd8-93bd-4c9ac13fa341">
Oct 25 17:47:30 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 17:47:30 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:30 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:30 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:30 user nova-compute[74739]:   </metadata>
Oct 25 17:47:30 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:30 user nova-compute[74739]:     <system>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="serial">c463c6be-cd71-4bd9-9b83-7485d5ff9afd</entry>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="uuid">c463c6be-cd71-4bd9-9b83-7485d5ff9afd</entry>
Oct 25 17:47:30 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:30 user nova-compute[74739]:     </system>
Oct 25 17:47:30 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:30 user nova-compute[74739]:   <os>
Oct 25 17:47:30 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:30 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:30 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:30 user nova-compute[74739]:   </os>
Oct 25 17:47:30 user nova-compute[74739]:   <features>
Oct 25 17:47:30 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:30 user nova-compute[74739]:     <apic/>
Oct 25 17:47:30 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:30 user nova-compute[74739]:   </features>
Oct 25 17:47:30 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:30 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:30 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:30 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:30 user nova-compute[74739]:   </clock>
Oct 25 17:47:30 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:30 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:30 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:30 user nova-compute[74739]:   </cpu>
Oct 25 17:47:30 user nova-compute[74739]:   <devices>
Oct 25 17:47:30 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:30 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:30 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk"/>
Oct 25 17:47:30 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:30 user nova-compute[74739]:     </disk>
Oct 25 17:47:30 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:30 user nova-compute[74739]:       <mac address="fa:16:3e:32:7d:54"/>
Oct 25 17:47:30 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:30 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:30 user nova-compute[74739]:       <target dev="tapa8bd265f-f5"/>
Oct 25 17:47:30 user nova-compute[74739]:     </interface>
Oct 25 17:47:30 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:30 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/console.log" append="off"/>
Oct 25 17:47:30 user nova-compute[74739]:     </serial>
Oct 25 17:47:30 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:30 user nova-compute[74739]:     <video>
Oct 25 17:47:30 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:30 user nova-compute[74739]:     </video>
Oct 25 17:47:30 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:30 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:30 user nova-compute[74739]:     </rng>
Oct 25 17:47:30 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:30 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:30 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:30 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:30 user nova-compute[74739]:   </devices>
Oct 25 17:47:30 user nova-compute[74739]: </domain>
Oct 25 17:47:30 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681183607',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681183607',id=2,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-7puwktqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:22Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=c463c6be-cd71-4bd9-9b83-7485d5ff9afd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG os_vif [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e30c10a-12ce-5183-ba70-b8602397547b', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8bd265f-f5, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8bd265f-f5, col_values=(('qos', UUID('77af829f-cb56-4c78-93dc-aa487dc553e0')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8bd265f-f5, col_values=(('external_ids', {'iface-id': 'a8bd265f-f516-4bd8-93bd-4c9ac13fa341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:7d:54', 'vm-uuid': 'c463c6be-cd71-4bd9-9b83-7485d5ff9afd'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:30 user nova-compute[74739]: INFO os_vif [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5')
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:32:7d:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Successfully created port: 1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Successfully created port: d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Successfully updated port: 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing instance network info cache due to event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance network_info: |[{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Successfully updated port: 1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start _get_guest_xml network_info=[{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:32 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:32 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOGwq+E25o3BF77wQI0+sGO22Qpe+iGvi5TaQSpJ2H+kXA6GjlXZjWZzf5GK4BFKu1xMTxPYdVEVeYc5XJVLgHTXy0kDO+/Qq3weG65sLCAhFYmOuur3zQhMOQ7KJ7b5Q==',key_name='tempest-keypair-770018984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_devices' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:32 user nova-compute[74739]:   <uuid>a8d9aaf2-caff-47c9-9add-1963381511d5</uuid>
Oct 25 17:47:32 user nova-compute[74739]:   <name>instance-00000003</name>
Oct 25 17:47:32 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:32 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:32 user nova-compute[74739]:   <metadata>
Oct 25 17:47:32 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:32 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-998219364</nova:name>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:32</nova:creationTime>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:32 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:32 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:user uuid="e140ed4e3e2f4d5abc2e08e1400715de">tempest-AttachVolumeShelveTestJSON-744521439-project-member</nova:user>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:project uuid="6c2a1dd2b0954a74be154b7082170334">tempest-AttachVolumeShelveTestJSON-744521439</nova:project>
Oct 25 17:47:32 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:32 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:32 user nova-compute[74739]:         <nova:port uuid="80d38ac3-dd49-49f5-bd49-64f4495084fa">
Oct 25 17:47:32 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 17:47:32 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:32 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:32 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:32 user nova-compute[74739]:   </metadata>
Oct 25 17:47:32 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:32 user nova-compute[74739]:     <system>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="serial">a8d9aaf2-caff-47c9-9add-1963381511d5</entry>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="uuid">a8d9aaf2-caff-47c9-9add-1963381511d5</entry>
Oct 25 17:47:32 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:32 user nova-compute[74739]:     </system>
Oct 25 17:47:32 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:32 user nova-compute[74739]:   <os>
Oct 25 17:47:32 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:32 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:32 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:32 user nova-compute[74739]:   </os>
Oct 25 17:47:32 user nova-compute[74739]:   <features>
Oct 25 17:47:32 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:32 user nova-compute[74739]:     <apic/>
Oct 25 17:47:32 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:32 user nova-compute[74739]:   </features>
Oct 25 17:47:32 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:32 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:32 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:32 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:32 user nova-compute[74739]:   </clock>
Oct 25 17:47:32 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:32 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:32 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:32 user nova-compute[74739]:   </cpu>
Oct 25 17:47:32 user nova-compute[74739]:   <devices>
Oct 25 17:47:32 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:32 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:32 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk"/>
Oct 25 17:47:32 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:32 user nova-compute[74739]:     </disk>
Oct 25 17:47:32 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:32 user nova-compute[74739]:       <mac address="fa:16:3e:df:c6:b0"/>
Oct 25 17:47:32 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:32 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:32 user nova-compute[74739]:       <target dev="tap80d38ac3-dd"/>
Oct 25 17:47:32 user nova-compute[74739]:     </interface>
Oct 25 17:47:32 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:32 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/console.log" append="off"/>
Oct 25 17:47:32 user nova-compute[74739]:     </serial>
Oct 25 17:47:32 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:32 user nova-compute[74739]:     <video>
Oct 25 17:47:32 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:32 user nova-compute[74739]:     </video>
Oct 25 17:47:32 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:32 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:32 user nova-compute[74739]:     </rng>
Oct 25 17:47:32 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:32 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:32 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:32 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:32 user nova-compute[74739]:   </devices>
Oct 25 17:47:32 user nova-compute[74739]: </domain>
Oct 25 17:47:32 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOGwq+E25o3BF77wQI0+sGO22Qpe+iGvi5TaQSpJ2H+kXA6GjlXZjWZzf5GK4BFKu1xMTxPYdVEVeYc5XJVLgHTXy0kDO+/Qq3weG65sLCAhFYmOuur3zQhMOQ7KJ7b5Q==',key_name='tempest-keypair-770018984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG os_vif [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0669993e-a4a0-5da5-aad7-7ff2a17ad02a', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80d38ac3-dd, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80d38ac3-dd, col_values=(('qos', UUID('01534bde-8613-480e-b37f-3b9df2f9aa5c')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80d38ac3-dd, col_values=(('external_ids', {'iface-id': '80d38ac3-dd49-49f5-bd49-64f4495084fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:c6:b0', 'vm-uuid': 'a8d9aaf2-caff-47c9-9add-1963381511d5'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:32 user nova-compute[74739]: INFO os_vif [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd')
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No VIF found with MAC fa:16:3e:df:c6:b0, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance network_info: |[{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start _get_guest_xml network_info=[{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'pci_devices' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updated VIF entry in instance network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:33 user nova-compute[74739]:   <uuid>7926c5ce-2435-4493-813f-4dca6e1f204f</uuid>
Oct 25 17:47:33 user nova-compute[74739]:   <name>instance-00000005</name>
Oct 25 17:47:33 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:33 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:33 user nova-compute[74739]:   <metadata>
Oct 25 17:47:33 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:33 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherB-server-660238142</nova:name>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:33</nova:creationTime>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:33 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:33 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:user uuid="4ace8d9977bb4a0f869bec3b8e79e2cd">tempest-ServerActionsTestOtherB-1769246220-project-member</nova:user>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:project uuid="8d1d84fb43034e9d9f6cf85063763000">tempest-ServerActionsTestOtherB-1769246220</nova:project>
Oct 25 17:47:33 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:33 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:33 user nova-compute[74739]:         <nova:port uuid="1a7792b1-73e4-43a3-b106-01d131c00444">
Oct 25 17:47:33 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 17:47:33 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:33 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:33 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:33 user nova-compute[74739]:   </metadata>
Oct 25 17:47:33 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:33 user nova-compute[74739]:     <system>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="serial">7926c5ce-2435-4493-813f-4dca6e1f204f</entry>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="uuid">7926c5ce-2435-4493-813f-4dca6e1f204f</entry>
Oct 25 17:47:33 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:33 user nova-compute[74739]:     </system>
Oct 25 17:47:33 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:33 user nova-compute[74739]:   <os>
Oct 25 17:47:33 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:33 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:33 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:33 user nova-compute[74739]:   </os>
Oct 25 17:47:33 user nova-compute[74739]:   <features>
Oct 25 17:47:33 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:33 user nova-compute[74739]:     <apic/>
Oct 25 17:47:33 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:33 user nova-compute[74739]:   </features>
Oct 25 17:47:33 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:33 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:33 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:33 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:33 user nova-compute[74739]:   </clock>
Oct 25 17:47:33 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:33 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:33 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:33 user nova-compute[74739]:   </cpu>
Oct 25 17:47:33 user nova-compute[74739]:   <devices>
Oct 25 17:47:33 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:33 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:33 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk"/>
Oct 25 17:47:33 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:33 user nova-compute[74739]:     </disk>
Oct 25 17:47:33 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:33 user nova-compute[74739]:       <mac address="fa:16:3e:07:4a:54"/>
Oct 25 17:47:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:33 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:33 user nova-compute[74739]:       <target dev="tap1a7792b1-73"/>
Oct 25 17:47:33 user nova-compute[74739]:     </interface>
Oct 25 17:47:33 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:33 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/console.log" append="off"/>
Oct 25 17:47:33 user nova-compute[74739]:     </serial>
Oct 25 17:47:33 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:33 user nova-compute[74739]:     <video>
Oct 25 17:47:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:33 user nova-compute[74739]:     </video>
Oct 25 17:47:33 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:33 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:33 user nova-compute[74739]:     </rng>
Oct 25 17:47:33 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:33 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:33 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:33 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:33 user nova-compute[74739]:   </devices>
Oct 25 17:47:33 user nova-compute[74739]: </domain>
Oct 25 17:47:33 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG os_vif [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4c9944c-088a-47de-89da-ad6fc001f162 req-a921ea55-c83a-48a1-97e0-73110c1f0932 service nova] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd11d1c8e-589b-5449-88c9-cd513b3018b6', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a7792b1-73, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a7792b1-73, col_values=(('qos', UUID('d4c6236b-f10d-49e9-8926-a0732e3d9aed')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a7792b1-73, col_values=(('external_ids', {'iface-id': '1a7792b1-73e4-43a3-b106-01d131c00444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:4a:54', 'vm-uuid': '7926c5ce-2435-4493-813f-4dca6e1f204f'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: INFO os_vif [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73')
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No VIF found with MAC fa:16:3e:07:4a:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-changed-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Refreshing instance network info cache due to event network-changed-1a7792b1-73e4-43a3-b106-01d131c00444. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Refreshing network info cache for port 1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Successfully updated port: d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance spawned successfully.
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updated VIF entry in instance network info cache for port 1a7792b1-73e4-43a3-b106-01d131c00444. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5a071ddd-175d-4304-8bae-cb2f7ea0876b req-2887c3df-1482-464a-9d15-1ff0259c95ce service nova] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:34 user nova-compute[74739]: INFO nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Took 12.35 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:34 user nova-compute[74739]: INFO nova.compute.manager [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Took 13.26 seconds to build instance.
Oct 25 17:47:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4d1921b5-632f-4b9c-9f87-854a69233b47 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.549s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing instance network info cache due to event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance network_info: |[{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start _get_guest_xml network_info=[{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:35 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:35 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2122672527',display_name='tempest-ServerStableDeviceRescueTest-server-2122672527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2122672527',id=4,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODut1pNslwSU4Di0lHh0C6EpfYOPqvghmvMnB4Fe1wEhoRAWbRcGpJBWvX1TZnxT/9xSDgreJ/BHuyJHTnD0o6tmk0d7vRiQepNtyDzSQHOe329v/2YQU9JiN9ugtZpxQ==',key_name='tempest-keypair-1409896089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9bfb1966da34253bbe550d1dbf97979',ramdisk_id='',reservation_id='r-5vd1zmhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-19504323',owner_user_name='tempest-ServerStableDeviceRescueTest-19504323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be7a94af5cae47709995a2d16346740c',uuid=cb37a637-7bf4-449d-b291-6986eea005e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converting VIF {"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'pci_devices' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:35 user nova-compute[74739]:   <uuid>cb37a637-7bf4-449d-b291-6986eea005e9</uuid>
Oct 25 17:47:35 user nova-compute[74739]:   <name>instance-00000004</name>
Oct 25 17:47:35 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:35 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:35 user nova-compute[74739]:   <metadata>
Oct 25 17:47:35 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:35 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2122672527</nova:name>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:35</nova:creationTime>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:35 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:35 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:user uuid="be7a94af5cae47709995a2d16346740c">tempest-ServerStableDeviceRescueTest-19504323-project-member</nova:user>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:project uuid="d9bfb1966da34253bbe550d1dbf97979">tempest-ServerStableDeviceRescueTest-19504323</nova:project>
Oct 25 17:47:35 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:35 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:35 user nova-compute[74739]:         <nova:port uuid="d7f62b72-2e75-4ead-a8be-5657f0d6b8a1">
Oct 25 17:47:35 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:47:35 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:35 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:35 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:35 user nova-compute[74739]:   </metadata>
Oct 25 17:47:35 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:35 user nova-compute[74739]:     <system>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="serial">cb37a637-7bf4-449d-b291-6986eea005e9</entry>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="uuid">cb37a637-7bf4-449d-b291-6986eea005e9</entry>
Oct 25 17:47:35 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:35 user nova-compute[74739]:     </system>
Oct 25 17:47:35 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:35 user nova-compute[74739]:   <os>
Oct 25 17:47:35 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:35 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:35 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:35 user nova-compute[74739]:   </os>
Oct 25 17:47:35 user nova-compute[74739]:   <features>
Oct 25 17:47:35 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:35 user nova-compute[74739]:     <apic/>
Oct 25 17:47:35 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:35 user nova-compute[74739]:   </features>
Oct 25 17:47:35 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:35 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:35 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:35 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:35 user nova-compute[74739]:   </clock>
Oct 25 17:47:35 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:35 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:35 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:35 user nova-compute[74739]:   </cpu>
Oct 25 17:47:35 user nova-compute[74739]:   <devices>
Oct 25 17:47:35 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:35 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:35 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk"/>
Oct 25 17:47:35 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:35 user nova-compute[74739]:     </disk>
Oct 25 17:47:35 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:35 user nova-compute[74739]:       <mac address="fa:16:3e:0a:58:cf"/>
Oct 25 17:47:35 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:35 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:35 user nova-compute[74739]:       <target dev="tapd7f62b72-2e"/>
Oct 25 17:47:35 user nova-compute[74739]:     </interface>
Oct 25 17:47:35 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:35 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/console.log" append="off"/>
Oct 25 17:47:35 user nova-compute[74739]:     </serial>
Oct 25 17:47:35 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:35 user nova-compute[74739]:     <video>
Oct 25 17:47:35 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:35 user nova-compute[74739]:     </video>
Oct 25 17:47:35 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:35 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:35 user nova-compute[74739]:     </rng>
Oct 25 17:47:35 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:35 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:35 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:35 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:35 user nova-compute[74739]:   </devices>
Oct 25 17:47:35 user nova-compute[74739]: </domain>
Oct 25 17:47:35 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2122672527',display_name='tempest-ServerStableDeviceRescueTest-server-2122672527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2122672527',id=4,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODut1pNslwSU4Di0lHh0C6EpfYOPqvghmvMnB4Fe1wEhoRAWbRcGpJBWvX1TZnxT/9xSDgreJ/BHuyJHTnD0o6tmk0d7vRiQepNtyDzSQHOe329v/2YQU9JiN9ugtZpxQ==',key_name='tempest-keypair-1409896089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9bfb1966da34253bbe550d1dbf97979',ramdisk_id='',reservation_id='r-5vd1zmhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-19504323',owner_user_name='tempest-ServerStableDeviceRescueTest-19504323-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be7a94af5cae47709995a2d16346740c',uuid=cb37a637-7bf4-449d-b291-6986eea005e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converting VIF {"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG os_vif [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acb2fc7c-cb9e-55eb-a4bd-e0f4f258fb70', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7f62b72-2e, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7f62b72-2e, col_values=(('qos', UUID('9a10ff76-72bd-40a6-a1cf-4771c3457550')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7f62b72-2e, col_values=(('external_ids', {'iface-id': 'd7f62b72-2e75-4ead-a8be-5657f0d6b8a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:58:cf', 'vm-uuid': 'cb37a637-7bf4-449d-b291-6986eea005e9'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:35 user nova-compute[74739]: INFO os_vif [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e')
Oct 25 17:47:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No VIF found with MAC fa:16:3e:0a:58:cf, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] No waiting events found dispatching network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:36 user nova-compute[74739]: WARNING nova.compute.manager [req-e19191c4-b1ff-4de9-81cd-001717e203e2 req-d8e4e7ba-a0cf-4cb7-b360-9dc4c7adfcd2 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received unexpected event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 for instance with vm_state active and task_state None.
Oct 25 17:47:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updated VIF entry in instance network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a118362a-86fb-4efb-933b-124ee65f32ac req-01eb41f1-cdbb-4a56-80dc-e8c8fb5c6bbc service nova] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] No waiting events found dispatching network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:38 user nova-compute[74739]: WARNING nova.compute.manager [req-c49ddf6d-8cd0-437b-b7d6-1dace65d88bd req-82f76a4b-8ea5-464c-8aba-dc5d735a4743 service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received unexpected event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 for instance with vm_state active and task_state None.
Oct 25 17:47:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance spawned successfully.
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:40 user nova-compute[74739]: INFO nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Took 13.49 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] No waiting events found dispatching network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:40 user nova-compute[74739]: WARNING nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received unexpected event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 for instance with vm_state active and task_state None.
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] No waiting events found dispatching network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:40 user nova-compute[74739]: WARNING nova.compute.manager [req-baba1f91-dfd7-4f35-96a2-9d8a1b750a8f req-82d6a7d1-d4cc-4376-9259-c168e16f1752 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received unexpected event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 for instance with vm_state active and task_state None.
Oct 25 17:47:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.compute.manager [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Took 14.74 seconds to build instance.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a533a4f-c4dc-4e65-87b7-da933214871b tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.961s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance spawned successfully.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Took 12.74 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.compute.manager [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Took 14.38 seconds to build instance.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c66522cc-491a-4197-b799-513f5d14ee85 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.538s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance spawned successfully.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Took 13.83 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:41 user nova-compute[74739]: INFO nova.compute.manager [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Took 15.20 seconds to build instance.
Oct 25 17:47:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41e83fca-1413-4cb1-96e2-ecf81c9c61a8 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.337s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:44 user nova-compute[74739]: INFO nova.compute.claims [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Claim successful on node user
Oct 25 17:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.policy [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a06fd9981b3417faea6ac4ad96f8cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bb4703f276148b49fde12b8e20375d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Creating image(s)
Oct 25 17:47:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "218114d20fc3ee387536a5331e30bc440c36d582" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "218114d20fc3ee387536a5331e30bc440c36d582" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.part --force-share --output=json" returned: 0 in 0.245s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG nova.virt.images [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] 0dbfb896-04fa-4e5b-bf98-192ca7d22fde was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.part /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.part /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.converted" returned: 0 in 0.360s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582.converted --force-share --output=json" returned: 0 in 0.359s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "218114d20fc3ee387536a5331e30bc440c36d582" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.666s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json" returned: 0 in 0.379s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "218114d20fc3ee387536a5331e30bc440c36d582" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "218114d20fc3ee387536a5331e30bc440c36d582" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json" returned: 0 in 0.354s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582,backing_fmt=raw /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582,backing_fmt=raw /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk 1073741824" returned: 0 in 0.070s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "218114d20fc3ee387536a5331e30bc440c36d582" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.433s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 --force-share --output=json" returned: 0 in 0.336s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.435s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Cannot resize image /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Ensure instance console log exists: /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Successfully created port: 4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Successfully updated port: 4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-changed-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Refreshing instance network info cache due to event network-changed-4f316f5c-99fe-4031-8f8b-f716b70b054e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] Acquiring lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] Acquired lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG nova.network.neutron [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Refreshing network info cache for port 4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f7ba650e-6e5d-44c2-bf70-657a8c8bf4cd req-777320d4-af73-4515-a008-de2d868948f2 service nova] Releasing lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquired lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:51 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating instance_info_cache with network_info: [{"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Releasing lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance network_info: |[{"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Start _get_guest_xml network_info=[{"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:47:36Z,direct_url=<?>,disk_format='qcow2',id=0dbfb896-04fa-4e5b-bf98-192ca7d22fde,min_disk=0,min_ram=0,name='',owner='61d97359aa82495f934e63c34060cffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:47:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '0dbfb896-04fa-4e5b-bf98-192ca7d22fde'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:47:36Z,direct_url=<?>,disk_format='qcow2',id=0dbfb896-04fa-4e5b-bf98-192ca7d22fde,min_disk=0,min_ram=0,name='',owner='61d97359aa82495f934e63c34060cffa',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:47:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535758845',display_name='tempest-AttachSCSIVolumeTestJSON-server-535758845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535758845',id=6,image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKuHpdcNIfHDvAyBu8nMagY/tT9r1yNVrG993Wc+E1iXolNQCMHZCcB5kagFGFrO6fMCFMxfLGXSOohzZYA4gRTjnoInZF5qCjEjQt5ZvP+S18lO8rRocJtU8Ygmtv7yA==',key_name='tempest-keypair-17758535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bb4703f276148b49fde12b8e20375d2',ramdisk_id='',reservation_id='r-33ew9ew9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1453914393',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1453914393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a06fd9981b3417faea6ac4ad96f8cb0',uuid=018d4427-32ef-4091-ae80-d30d33785609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converting VIF {"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.objects.instance [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lazy-loading 'pci_devices' on Instance uuid 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:52 user nova-compute[74739]:   <uuid>018d4427-32ef-4091-ae80-d30d33785609</uuid>
Oct 25 17:47:52 user nova-compute[74739]:   <name>instance-00000006</name>
Oct 25 17:47:52 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:52 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:52 user nova-compute[74739]:   <metadata>
Oct 25 17:47:52 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:52 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-535758845</nova:name>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:52</nova:creationTime>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:52 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:52 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:user uuid="9a06fd9981b3417faea6ac4ad96f8cb0">tempest-AttachSCSIVolumeTestJSON-1453914393-project-member</nova:user>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:project uuid="2bb4703f276148b49fde12b8e20375d2">tempest-AttachSCSIVolumeTestJSON-1453914393</nova:project>
Oct 25 17:47:52 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:root type="image" uuid="0dbfb896-04fa-4e5b-bf98-192ca7d22fde"/>
Oct 25 17:47:52 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:52 user nova-compute[74739]:         <nova:port uuid="4f316f5c-99fe-4031-8f8b-f716b70b054e">
Oct 25 17:47:52 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 17:47:52 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:52 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:52 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:52 user nova-compute[74739]:   </metadata>
Oct 25 17:47:52 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:52 user nova-compute[74739]:     <system>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="serial">018d4427-32ef-4091-ae80-d30d33785609</entry>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="uuid">018d4427-32ef-4091-ae80-d30d33785609</entry>
Oct 25 17:47:52 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:52 user nova-compute[74739]:     </system>
Oct 25 17:47:52 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:52 user nova-compute[74739]:   <os>
Oct 25 17:47:52 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:52 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:52 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:52 user nova-compute[74739]:   </os>
Oct 25 17:47:52 user nova-compute[74739]:   <features>
Oct 25 17:47:52 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:52 user nova-compute[74739]:     <apic/>
Oct 25 17:47:52 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:52 user nova-compute[74739]:   </features>
Oct 25 17:47:52 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:52 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:52 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:52 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:52 user nova-compute[74739]:   </clock>
Oct 25 17:47:52 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:52 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:52 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:52 user nova-compute[74739]:   </cpu>
Oct 25 17:47:52 user nova-compute[74739]:   <devices>
Oct 25 17:47:52 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:52 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:52 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk"/>
Oct 25 17:47:52 user nova-compute[74739]:       <target dev="sda" bus="scsi"/>
Oct 25 17:47:52 user nova-compute[74739]:       <address type="drive" controller="0" unit="0"/>
Oct 25 17:47:52 user nova-compute[74739]:     </disk>
Oct 25 17:47:52 user nova-compute[74739]:     <disk type="file" device="cdrom">
Oct 25 17:47:52 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 17:47:52 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.config"/>
Oct 25 17:47:52 user nova-compute[74739]:       <target dev="sdb" bus="scsi"/>
Oct 25 17:47:52 user nova-compute[74739]:       <address type="drive" controller="0" unit="1"/>
Oct 25 17:47:52 user nova-compute[74739]:     </disk>
Oct 25 17:47:52 user nova-compute[74739]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 25 17:47:52 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:52 user nova-compute[74739]:       <mac address="fa:16:3e:9b:19:7a"/>
Oct 25 17:47:52 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:52 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:52 user nova-compute[74739]:       <target dev="tap4f316f5c-99"/>
Oct 25 17:47:52 user nova-compute[74739]:     </interface>
Oct 25 17:47:52 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:52 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/console.log" append="off"/>
Oct 25 17:47:52 user nova-compute[74739]:     </serial>
Oct 25 17:47:52 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:52 user nova-compute[74739]:     <video>
Oct 25 17:47:52 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:52 user nova-compute[74739]:     </video>
Oct 25 17:47:52 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:52 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:52 user nova-compute[74739]:     </rng>
Oct 25 17:47:52 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:52 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:52 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:52 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:52 user nova-compute[74739]:   </devices>
Oct 25 17:47:52 user nova-compute[74739]: </domain>
Oct 25 17:47:52 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535758845',display_name='tempest-AttachSCSIVolumeTestJSON-server-535758845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535758845',id=6,image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKuHpdcNIfHDvAyBu8nMagY/tT9r1yNVrG993Wc+E1iXolNQCMHZCcB5kagFGFrO6fMCFMxfLGXSOohzZYA4gRTjnoInZF5qCjEjQt5ZvP+S18lO8rRocJtU8Ygmtv7yA==',key_name='tempest-keypair-17758535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bb4703f276148b49fde12b8e20375d2',ramdisk_id='',reservation_id='r-33ew9ew9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1453914393',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1453914393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a06fd9981b3417faea6ac4ad96f8cb0',uuid=018d4427-32ef-4091-ae80-d30d33785609,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converting VIF {"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG os_vif [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdc4b7d7-3ec3-54f9-b10b-2ab7d8a8313b', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f316f5c-99, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f316f5c-99, col_values=(('qos', UUID('c989d672-1fd7-44c6-9a29-aa395cb0ca44')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f316f5c-99, col_values=(('external_ids', {'iface-id': '4f316f5c-99fe-4031-8f8b-f716b70b054e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:19:7a', 'vm-uuid': '018d4427-32ef-4091-ae80-d30d33785609'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:52 user nova-compute[74739]: INFO os_vif [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99')
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No BDM found with device name sda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No VIF found with MAC fa:16:3e:9b:19:7a, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Using config drive
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:52 user nova-compute[74739]: WARNING nova.compute.manager [req-97cdbd1e-6782-4cf1-ab8b-e89c0a004c65 req-68ff4e93-632f-4edf-b47d-e60d45baed2d service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state None.
Oct 25 17:47:53 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Creating config drive at /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.config
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbyn6y0bh {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbyn6y0bh" returned: 0 in 0.087s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 0 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:54 user nova-compute[74739]: INFO nova.compute.claims [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Claim successful on node user
Oct 25 17:47:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG nova.policy [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8930b582ad7e43f9b431f64b51b7a14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efaa30b9fa074f12a9f43f3a1644916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Creating image(s)
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "/opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "/opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "/opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:47:55 user nova-compute[74739]: WARNING nova.compute.manager [req-93a69dcb-2bfd-4c6d-8130-e6c3a76257eb req-037a356c-db74-49a6-832e-05fdeaf7b88a service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state None.
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.278s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.295s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk 1073741824" returned: 0 in 0.071s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.334s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Successfully created port: 057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Cannot resize image /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Ensure instance console log exists: /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:47:56 user nova-compute[74739]: INFO nova.compute.claims [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Claim successful on node user
Oct 25 17:47:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Successfully updated port: 057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquired lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-changed-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Refreshing instance network info cache due to event network-changed-057ce179-04c7-41cc-b134-04d70a56e21e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] Acquiring lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.825s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Updating instance_info_cache with network_info: [{"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Releasing lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Instance network_info: |[{"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] Acquired lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Refreshing network info cache for port 057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Start _get_guest_xml network_info=[{"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:47:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:47:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1815133267',display_name='tempest-VolumesActionsTest-instance-1815133267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1815133267',id=7,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efaa30b9fa074f12a9f43f3a1644916d',ramdisk_id='',reservation_id='r-77ydyxdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1170425060',owner_user_name='tempest-VolumesActionsTest-1170425060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:55Z,user_data=None,user_id='8930b582ad7e43f9b431f64b51b7a14e',uuid=04153d63-4a29-4ecc-97b3-e557868a8a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converting VIF {"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lazy-loading 'pci_devices' on Instance uuid 04153d63-4a29-4ecc-97b3-e557868a8a4a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:47:58 user nova-compute[74739]:   <uuid>04153d63-4a29-4ecc-97b3-e557868a8a4a</uuid>
Oct 25 17:47:58 user nova-compute[74739]:   <name>instance-00000007</name>
Oct 25 17:47:58 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:47:58 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:47:58 user nova-compute[74739]:   <metadata>
Oct 25 17:47:58 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:47:58 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:name>tempest-VolumesActionsTest-instance-1815133267</nova:name>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:47:58</nova:creationTime>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:47:58 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:47:58 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:owner>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:user uuid="8930b582ad7e43f9b431f64b51b7a14e">tempest-VolumesActionsTest-1170425060-project-member</nova:user>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:project uuid="efaa30b9fa074f12a9f43f3a1644916d">tempest-VolumesActionsTest-1170425060</nova:project>
Oct 25 17:47:58 user nova-compute[74739]:       </nova:owner>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:47:58 user nova-compute[74739]:       <nova:ports>
Oct 25 17:47:58 user nova-compute[74739]:         <nova:port uuid="057ce179-04c7-41cc-b134-04d70a56e21e">
Oct 25 17:47:58 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 17:47:58 user nova-compute[74739]:         </nova:port>
Oct 25 17:47:58 user nova-compute[74739]:       </nova:ports>
Oct 25 17:47:58 user nova-compute[74739]:     </nova:instance>
Oct 25 17:47:58 user nova-compute[74739]:   </metadata>
Oct 25 17:47:58 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:47:58 user nova-compute[74739]:     <system>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="serial">04153d63-4a29-4ecc-97b3-e557868a8a4a</entry>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="uuid">04153d63-4a29-4ecc-97b3-e557868a8a4a</entry>
Oct 25 17:47:58 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:47:58 user nova-compute[74739]:     </system>
Oct 25 17:47:58 user nova-compute[74739]:   </sysinfo>
Oct 25 17:47:58 user nova-compute[74739]:   <os>
Oct 25 17:47:58 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:47:58 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:47:58 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:47:58 user nova-compute[74739]:   </os>
Oct 25 17:47:58 user nova-compute[74739]:   <features>
Oct 25 17:47:58 user nova-compute[74739]:     <acpi/>
Oct 25 17:47:58 user nova-compute[74739]:     <apic/>
Oct 25 17:47:58 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:47:58 user nova-compute[74739]:   </features>
Oct 25 17:47:58 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:47:58 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:47:58 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:47:58 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:47:58 user nova-compute[74739]:   </clock>
Oct 25 17:47:58 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:47:58 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:47:58 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:47:58 user nova-compute[74739]:   </cpu>
Oct 25 17:47:58 user nova-compute[74739]:   <devices>
Oct 25 17:47:58 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:47:58 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:47:58 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk"/>
Oct 25 17:47:58 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:47:58 user nova-compute[74739]:     </disk>
Oct 25 17:47:58 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:47:58 user nova-compute[74739]:       <mac address="fa:16:3e:ab:a2:93"/>
Oct 25 17:47:58 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:58 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:47:58 user nova-compute[74739]:       <target dev="tap057ce179-04"/>
Oct 25 17:47:58 user nova-compute[74739]:     </interface>
Oct 25 17:47:58 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:47:58 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/console.log" append="off"/>
Oct 25 17:47:58 user nova-compute[74739]:     </serial>
Oct 25 17:47:58 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:47:58 user nova-compute[74739]:     <video>
Oct 25 17:47:58 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:47:58 user nova-compute[74739]:     </video>
Oct 25 17:47:58 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:47:58 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:47:58 user nova-compute[74739]:     </rng>
Oct 25 17:47:58 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:47:58 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:47:58 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:47:58 user nova-compute[74739]:     </memballoon>
Oct 25 17:47:58 user nova-compute[74739]:   </devices>
Oct 25 17:47:58 user nova-compute[74739]: </domain>
Oct 25 17:47:58 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1815133267',display_name='tempest-VolumesActionsTest-instance-1815133267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1815133267',id=7,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='efaa30b9fa074f12a9f43f3a1644916d',ramdisk_id='',reservation_id='r-77ydyxdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1170425060',owner_user_name='tempest-VolumesActionsTest-1170425060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:55Z,user_data=None,user_id='8930b582ad7e43f9b431f64b51b7a14e',uuid=04153d63-4a29-4ecc-97b3-e557868a8a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converting VIF {"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG os_vif [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18b7b019-a1d6-5935-adc1-6add9c61fc3d', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057ce179-04, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057ce179-04, col_values=(('qos', UUID('7f43dd4d-1849-4ece-b564-19f6bc1996b1')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057ce179-04, col_values=(('external_ids', {'iface-id': '057ce179-04c7-41cc-b134-04d70a56e21e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:a2:93', 'vm-uuid': '04153d63-4a29-4ecc-97b3-e557868a8a4a'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:58 user nova-compute[74739]: INFO os_vif [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04')
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:47:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance spawned successfully.
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] No VIF found with MAC fa:16:3e:ab:a2:93, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.policy [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f7c0167f56645938072e7ec7a79538f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d81620669f1439d97ca2ab8bec75077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:47:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Creating image(s)
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "/opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "/opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "/opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:58 user nova-compute[74739]: INFO nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Took 13.02 seconds to spawn the instance on the hypervisor.
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:47:58 user nova-compute[74739]: INFO nova.compute.manager [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Took 14.39 seconds to build instance.
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-69f5fb95-d245-4950-8f81-70312f2bc18c tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.684s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.275s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.neutron [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Updated VIF entry in instance network info cache for port 057ce179-04c7-41cc-b134-04d70a56e21e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.network.neutron [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Updating instance_info_cache with network_info: [{"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16f04efc-93de-422d-b041-10d16c442918 req-cd4d2687-f6eb-4278-85a4-ca2659f61c1a service nova] Releasing lock "refresh_cache-04153d63-4a29-4ecc-97b3-e557868a8a4a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.260s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Skipping network cache update for instance because it is Building. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Skipping network cache update for instance because it is Building. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk 1073741824" returned: 0 in 0.062s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 78ae4728-74df-4d51-b3ad-c550f2e95850 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Cannot resize image /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Ensure instance console log exists: /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Successfully created port: 8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating instance_info_cache with network_info: [{"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-78ae4728-74df-4d51-b3ad-c550f2e95850" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:47:59 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] No waiting events found dispatching network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:00 user nova-compute[74739]: WARNING nova.compute.manager [req-4a7a2061-8a7e-44dd-a25b-708a52ec4ef8 req-9d1a1736-28c1-4aa1-8ceb-be93cafb50d2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received unexpected event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e for instance with vm_state building and task_state spawning.
Oct 25 17:48:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Successfully updated port: 8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquired lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-changed-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Refreshing instance network info cache due to event network-changed-8ef64567-0d19-4a6a-86a7-22a37ef0c882. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] Acquiring lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json" returned: 0 in 0.409s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:48:02 user nova-compute[74739]: INFO nova.compute.claims [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Claim successful on node user
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updating instance_info_cache with network_info: [{"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Releasing lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Instance network_info: |[{"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] Acquired lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Refreshing network info cache for port 8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Start _get_guest_xml network_info=[{"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:48:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1365366211',display_name='tempest-TestVolumeSwap-server-1365366211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1365366211',id=8,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAJAnGApQm/OC/hbNe6UG5388QzNEwG5pxaKUOq87m06/j2ZMZEovNKn29ebu/SfDmpYyLdj07Wi0n46lo0FdLTcfjlWxaOwNsm6F1Zoz1LavpVCe5VOYa0PxPchSPLIQ==',key_name='tempest-keypair-2064246814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d81620669f1439d97ca2ab8bec75077',ramdisk_id='',reservation_id='r-2awhfpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1896463606',owner_user_name='tempest-TestVolumeSwap-1896463606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7c0167f56645938072e7ec7a79538f',uuid=59ca18ab-9b5c-4738-b9f6-955dc6e48be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converting VIF {"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lazy-loading 'pci_devices' on Instance uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:48:02 user nova-compute[74739]:   <uuid>59ca18ab-9b5c-4738-b9f6-955dc6e48be8</uuid>
Oct 25 17:48:02 user nova-compute[74739]:   <name>instance-00000008</name>
Oct 25 17:48:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:48:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:48:02 user nova-compute[74739]:   <metadata>
Oct 25 17:48:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:48:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:name>tempest-TestVolumeSwap-server-1365366211</nova:name>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:48:02</nova:creationTime>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:48:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:48:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:owner>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:user uuid="2f7c0167f56645938072e7ec7a79538f">tempest-TestVolumeSwap-1896463606-project-member</nova:user>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:project uuid="2d81620669f1439d97ca2ab8bec75077">tempest-TestVolumeSwap-1896463606</nova:project>
Oct 25 17:48:02 user nova-compute[74739]:       </nova:owner>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:48:02 user nova-compute[74739]:       <nova:ports>
Oct 25 17:48:02 user nova-compute[74739]:         <nova:port uuid="8ef64567-0d19-4a6a-86a7-22a37ef0c882">
Oct 25 17:48:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 17:48:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:48:02 user nova-compute[74739]:       </nova:ports>
Oct 25 17:48:02 user nova-compute[74739]:     </nova:instance>
Oct 25 17:48:02 user nova-compute[74739]:   </metadata>
Oct 25 17:48:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:48:02 user nova-compute[74739]:     <system>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="serial">59ca18ab-9b5c-4738-b9f6-955dc6e48be8</entry>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="uuid">59ca18ab-9b5c-4738-b9f6-955dc6e48be8</entry>
Oct 25 17:48:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:48:02 user nova-compute[74739]:     </system>
Oct 25 17:48:02 user nova-compute[74739]:   </sysinfo>
Oct 25 17:48:02 user nova-compute[74739]:   <os>
Oct 25 17:48:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:48:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:48:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:48:02 user nova-compute[74739]:   </os>
Oct 25 17:48:02 user nova-compute[74739]:   <features>
Oct 25 17:48:02 user nova-compute[74739]:     <acpi/>
Oct 25 17:48:02 user nova-compute[74739]:     <apic/>
Oct 25 17:48:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:48:02 user nova-compute[74739]:   </features>
Oct 25 17:48:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:48:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:48:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:48:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:48:02 user nova-compute[74739]:   </clock>
Oct 25 17:48:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:48:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:48:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:48:02 user nova-compute[74739]:   </cpu>
Oct 25 17:48:02 user nova-compute[74739]:   <devices>
Oct 25 17:48:02 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:48:02 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:48:02 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk"/>
Oct 25 17:48:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:48:02 user nova-compute[74739]:     </disk>
Oct 25 17:48:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:48:02 user nova-compute[74739]:       <mac address="fa:16:3e:6e:2f:94"/>
Oct 25 17:48:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:48:02 user nova-compute[74739]:       <target dev="tap8ef64567-0d"/>
Oct 25 17:48:02 user nova-compute[74739]:     </interface>
Oct 25 17:48:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:48:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/console.log" append="off"/>
Oct 25 17:48:02 user nova-compute[74739]:     </serial>
Oct 25 17:48:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:48:02 user nova-compute[74739]:     <video>
Oct 25 17:48:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:02 user nova-compute[74739]:     </video>
Oct 25 17:48:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:48:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:48:02 user nova-compute[74739]:     </rng>
Oct 25 17:48:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:48:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:48:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:48:02 user nova-compute[74739]:     </memballoon>
Oct 25 17:48:02 user nova-compute[74739]:   </devices>
Oct 25 17:48:02 user nova-compute[74739]: </domain>
Oct 25 17:48:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1365366211',display_name='tempest-TestVolumeSwap-server-1365366211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1365366211',id=8,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAJAnGApQm/OC/hbNe6UG5388QzNEwG5pxaKUOq87m06/j2ZMZEovNKn29ebu/SfDmpYyLdj07Wi0n46lo0FdLTcfjlWxaOwNsm6F1Zoz1LavpVCe5VOYa0PxPchSPLIQ==',key_name='tempest-keypair-2064246814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d81620669f1439d97ca2ab8bec75077',ramdisk_id='',reservation_id='r-2awhfpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1896463606',owner_user_name='tempest-TestVolumeSwap-1896463606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7c0167f56645938072e7ec7a79538f',uuid=59ca18ab-9b5c-4738-b9f6-955dc6e48be8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converting VIF {"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG os_vif [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc633a73-766f-535b-ba81-9b7b7b2c0194', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ef64567-0d, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ef64567-0d, col_values=(('qos', UUID('f487c581-9e8a-48e5-b708-a713b3550899')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ef64567-0d, col_values=(('external_ids', {'iface-id': '8ef64567-0d19-4a6a-86a7-22a37ef0c882', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:2f:94', 'vm-uuid': '59ca18ab-9b5c-4738-b9f6-955dc6e48be8'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:02 user nova-compute[74739]: INFO os_vif [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d')
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] No waiting events found dispatching network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:02 user nova-compute[74739]: WARNING nova.compute.manager [req-6d0f3083-6b52-40b4-8154-03772159485f req-e265f61f-ae29-48bd-97be-d22c821c173e service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received unexpected event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e for instance with vm_state building and task_state spawning.
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] No VIF found with MAC fa:16:3e:6e:2f:94, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.983s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:48:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:03 user nova-compute[74739]: WARNING nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state active and task_state None.
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:03 user nova-compute[74739]: WARNING nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state active and task_state None.
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:03 user nova-compute[74739]: WARNING nova.compute.manager [req-813c2e1d-cb54-4a39-a281-3e355a03a59e req-c8af189d-bab0-40d2-b5c8-b484663995c8 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state None.
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.policy [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f303bb86710a455d823cf353b24da137', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca00e5558cc4ab9bd1fb6d3d3eb0158', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updated VIF entry in instance network info cache for port 8ef64567-0d19-4a6a-86a7-22a37ef0c882. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updating instance_info_cache with network_info: [{"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:48:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Creating image(s)
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "/opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "/opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "/opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-620e34ef-adbd-42c4-bf5f-c9f84f424bd6 req-5d02dc0e-e1ac-4c24-88ab-98ae2c82bb8d service nova] Releasing lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Instance spawned successfully.
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:03 user nova-compute[74739]: INFO nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Took 8.72 seconds to spawn the instance on the hypervisor.
Oct 25 17:48:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.400s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: INFO nova.compute.manager [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Took 9.97 seconds to build instance.
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ec44ff5b-0b29-4a12-9bb0-cdf6338de7b0 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.209s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.267s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk 1073741824" returned: 0 in 0.105s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Successfully created port: 7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.295s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Cannot resize image /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Ensure instance console log exists: /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Successfully updated port: 7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-changed-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Refreshing instance network info cache due to event network-changed-7e87b1fd-fdce-4810-b4c5-2690d673240b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] Acquiring lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] Acquired lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Refreshing network info cache for port 7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:07 user nova-compute[74739]: WARNING nova.compute.manager [req-e4a808c2-c3ba-4c2d-abe5-9821ff85aa0f req-428226d0-1bad-4990-ba51-1558329c608d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state None.
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:48:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.network.neutron [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:48:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7953MB free_disk=25.656295776367188GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Instance spawned successfully.
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:08 user nova-compute[74739]: INFO nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Took 9.93 seconds to spawn the instance on the hypervisor.
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 78ae4728-74df-4d51-b3ad-c550f2e95850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance a8d9aaf2-caff-47c9-9add-1963381511d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 018d4427-32ef-4091-ae80-d30d33785609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 04153d63-4a29-4ecc-97b3-e557868a8a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c25ffdb2-6a06-4901-a454-02e6a379bffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:48:08 user nova-compute[74739]: INFO nova.compute.manager [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Took 11.68 seconds to build instance.
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.network.neutron [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56dc8330-df25-432e-a9de-ea4677bfb54a req-710fceb9-1735-442d-af0d-26dfed92c84b service nova] Releasing lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-840825dc-f78a-4acc-8197-c64ff7982563 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.846s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquired lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] No waiting events found dispatching network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:08 user nova-compute[74739]: WARNING nova.compute.manager [req-d8037d4a-175b-4431-bf4a-64285b08f640 req-6577bac9-b10b-4289-9ff3-40bc93ef3223 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received unexpected event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e for instance with vm_state active and task_state None.
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.031s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updating instance_info_cache with network_info: [{"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Releasing lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance network_info: |[{"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Start _get_guest_xml network_info=[{"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:48:09 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:09 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1846438781',display_name='tempest-VolumesAssistedSnapshotsTest-server-1846438781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1846438781',id=9,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4nP7TSkg4+HElGj7a2cl5KZjzjTcMo8Q6OfqbyN/F2Pj56efKw/STZdF/o5yWHQ12rrMYVt1dMxTykyAz2SXGDuMlHJ/InGZ0o43VOtN14Jw9C/ol02haQFkNiOHbpSg==',key_name='tempest-keypair-575333134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ca00e5558cc4ab9bd1fb6d3d3eb0158',ramdisk_id='',reservation_id='r-q00g03vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-158223859',owner_user_name='tempest-VolumesAssistedSnapshotsTest-158223859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f303bb86710a455d823cf353b24da137',uuid=c25ffdb2-6a06-4901-a454-02e6a379bffb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converting VIF {"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.objects.instance [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lazy-loading 'pci_devices' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:48:09 user nova-compute[74739]:   <uuid>c25ffdb2-6a06-4901-a454-02e6a379bffb</uuid>
Oct 25 17:48:09 user nova-compute[74739]:   <name>instance-00000009</name>
Oct 25 17:48:09 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:48:09 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:48:09 user nova-compute[74739]:   <metadata>
Oct 25 17:48:09 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:48:09 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1846438781</nova:name>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:48:09</nova:creationTime>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:48:09 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:48:09 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:owner>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:user uuid="f303bb86710a455d823cf353b24da137">tempest-VolumesAssistedSnapshotsTest-158223859-project-member</nova:user>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:project uuid="5ca00e5558cc4ab9bd1fb6d3d3eb0158">tempest-VolumesAssistedSnapshotsTest-158223859</nova:project>
Oct 25 17:48:09 user nova-compute[74739]:       </nova:owner>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:48:09 user nova-compute[74739]:       <nova:ports>
Oct 25 17:48:09 user nova-compute[74739]:         <nova:port uuid="7e87b1fd-fdce-4810-b4c5-2690d673240b">
Oct 25 17:48:09 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 17:48:09 user nova-compute[74739]:         </nova:port>
Oct 25 17:48:09 user nova-compute[74739]:       </nova:ports>
Oct 25 17:48:09 user nova-compute[74739]:     </nova:instance>
Oct 25 17:48:09 user nova-compute[74739]:   </metadata>
Oct 25 17:48:09 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:48:09 user nova-compute[74739]:     <system>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="serial">c25ffdb2-6a06-4901-a454-02e6a379bffb</entry>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="uuid">c25ffdb2-6a06-4901-a454-02e6a379bffb</entry>
Oct 25 17:48:09 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:48:09 user nova-compute[74739]:     </system>
Oct 25 17:48:09 user nova-compute[74739]:   </sysinfo>
Oct 25 17:48:09 user nova-compute[74739]:   <os>
Oct 25 17:48:09 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:48:09 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:48:09 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:48:09 user nova-compute[74739]:   </os>
Oct 25 17:48:09 user nova-compute[74739]:   <features>
Oct 25 17:48:09 user nova-compute[74739]:     <acpi/>
Oct 25 17:48:09 user nova-compute[74739]:     <apic/>
Oct 25 17:48:09 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:48:09 user nova-compute[74739]:   </features>
Oct 25 17:48:09 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:48:09 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:48:09 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:48:09 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:48:09 user nova-compute[74739]:   </clock>
Oct 25 17:48:09 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:48:09 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:48:09 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:48:09 user nova-compute[74739]:   </cpu>
Oct 25 17:48:09 user nova-compute[74739]:   <devices>
Oct 25 17:48:09 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:48:09 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:48:09 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk"/>
Oct 25 17:48:09 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:48:09 user nova-compute[74739]:     </disk>
Oct 25 17:48:09 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:48:09 user nova-compute[74739]:       <mac address="fa:16:3e:cd:59:23"/>
Oct 25 17:48:09 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:09 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:48:09 user nova-compute[74739]:       <target dev="tap7e87b1fd-fd"/>
Oct 25 17:48:09 user nova-compute[74739]:     </interface>
Oct 25 17:48:09 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:48:09 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/console.log" append="off"/>
Oct 25 17:48:09 user nova-compute[74739]:     </serial>
Oct 25 17:48:09 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:48:09 user nova-compute[74739]:     <video>
Oct 25 17:48:09 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:09 user nova-compute[74739]:     </video>
Oct 25 17:48:09 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:48:09 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:48:09 user nova-compute[74739]:     </rng>
Oct 25 17:48:09 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:48:09 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:48:09 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:48:09 user nova-compute[74739]:     </memballoon>
Oct 25 17:48:09 user nova-compute[74739]:   </devices>
Oct 25 17:48:09 user nova-compute[74739]: </domain>
Oct 25 17:48:09 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1846438781',display_name='tempest-VolumesAssistedSnapshotsTest-server-1846438781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1846438781',id=9,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4nP7TSkg4+HElGj7a2cl5KZjzjTcMo8Q6OfqbyN/F2Pj56efKw/STZdF/o5yWHQ12rrMYVt1dMxTykyAz2SXGDuMlHJ/InGZ0o43VOtN14Jw9C/ol02haQFkNiOHbpSg==',key_name='tempest-keypair-575333134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ca00e5558cc4ab9bd1fb6d3d3eb0158',ramdisk_id='',reservation_id='r-q00g03vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-158223859',owner_user_name='tempest-VolumesAssistedSnapshotsTest-158223859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f303bb86710a455d823cf353b24da137',uuid=c25ffdb2-6a06-4901-a454-02e6a379bffb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converting VIF {"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG os_vif [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42bf6992-cdf0-56c4-bd68-ea822066ea52', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e87b1fd-fd, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e87b1fd-fd, col_values=(('qos', UUID('4a39cb99-b5ea-4cc0-91c0-169e3160913b')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e87b1fd-fd, col_values=(('external_ids', {'iface-id': '7e87b1fd-fdce-4810-b4c5-2690d673240b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:59:23', 'vm-uuid': 'c25ffdb2-6a06-4901-a454-02e6a379bffb'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: INFO os_vif [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd')
Oct 25 17:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:48:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] No VIF found with MAC fa:16:3e:cd:59:23, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] No waiting events found dispatching network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:11 user nova-compute[74739]: WARNING nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received unexpected event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e for instance with vm_state active and task_state None.
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] No waiting events found dispatching network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:11 user nova-compute[74739]: WARNING nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received unexpected event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 for instance with vm_state active and task_state None.
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] No waiting events found dispatching network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:11 user nova-compute[74739]: WARNING nova.compute.manager [req-db6126a9-2a03-4604-953f-d01bfd00859b req-57bf3dca-0872-4e54-b7ee-22c5e9d46486 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received unexpected event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 for instance with vm_state active and task_state None.
Oct 25 17:48:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:48:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance spawned successfully.
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:48:13 user nova-compute[74739]: INFO nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Took 10.44 seconds to spawn the instance on the hypervisor.
Oct 25 17:48:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:48:14 user nova-compute[74739]: INFO nova.compute.manager [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Took 12.27 seconds to build instance.
Oct 25 17:48:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a94368c9-9d62-47de-929d-8adff824deb3 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.641s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] No waiting events found dispatching network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:15 user nova-compute[74739]: WARNING nova.compute.manager [req-00b44d94-af9f-44de-b44b-eef5a44a7379 req-d0a5ae01-0fa7-435e-a078-f24ae6f88cde service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received unexpected event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b for instance with vm_state active and task_state None.
Oct 25 17:48:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] No waiting events found dispatching network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:17 user nova-compute[74739]: WARNING nova.compute.manager [req-2ab3d2ad-bfe8-454b-a976-fa3e68cdf98e req-be20d8b2-f649-4af7-bd2b-82d68b24131b service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received unexpected event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b for instance with vm_state active and task_state None.
Oct 25 17:48:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:48:54 user nova-compute[74739]: INFO nova.compute.claims [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Claim successful on node user
Oct 25 17:48:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:48:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.policy [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f9c0d42d1a402c8c17d32a328dd67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d58fc42ec534beb8c2e756b6f7edc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:48:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Creating image(s)
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "/opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "/opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.291s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk 1073741824" returned: 0 in 0.043s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Successfully created port: fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Cannot resize image /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Ensure instance console log exists: /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Successfully updated port: fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquired lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received event network-changed-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Refreshing instance network info cache due to event network-changed-fab33d97-c0af-43d1-bea2-5b862371e93e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] Acquiring lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating instance_info_cache with network_info: [{"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Releasing lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Instance network_info: |[{"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] Acquired lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Refreshing network info cache for port fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Start _get_guest_xml network_info=[{"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:48:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1887983099',display_name='tempest-VolumesSnapshotTestJSON-instance-1887983099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1887983099',id=10,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgSk72kfnBLo7p1zeXIL+vNdelFDzc7Jz8d9B7GqSAfBuHsH6tHlFrFumZI281dlSZTxR6AInaRpfSMI2A+E3XGZkn8lESWzGN60dfbjwuyuhGRvaYIjdLuYcaPDsxNhg==',key_name='tempest-keypair-2016874935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-3w1tmzls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=bdcd3887-b9d6-42f3-b758-1410e22af542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'pci_devices' on Instance uuid bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:48:56 user nova-compute[74739]:   <uuid>bdcd3887-b9d6-42f3-b758-1410e22af542</uuid>
Oct 25 17:48:56 user nova-compute[74739]:   <name>instance-0000000a</name>
Oct 25 17:48:56 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:48:56 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:48:56 user nova-compute[74739]:   <metadata>
Oct 25 17:48:56 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:48:56 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1887983099</nova:name>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:48:56</nova:creationTime>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:48:56 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:48:56 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:owner>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:user uuid="b9f9c0d42d1a402c8c17d32a328dd67f">tempest-VolumesSnapshotTestJSON-1623722059-project-member</nova:user>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:project uuid="2d58fc42ec534beb8c2e756b6f7edc3d">tempest-VolumesSnapshotTestJSON-1623722059</nova:project>
Oct 25 17:48:56 user nova-compute[74739]:       </nova:owner>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:48:56 user nova-compute[74739]:       <nova:ports>
Oct 25 17:48:56 user nova-compute[74739]:         <nova:port uuid="fab33d97-c0af-43d1-bea2-5b862371e93e">
Oct 25 17:48:56 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 17:48:56 user nova-compute[74739]:         </nova:port>
Oct 25 17:48:56 user nova-compute[74739]:       </nova:ports>
Oct 25 17:48:56 user nova-compute[74739]:     </nova:instance>
Oct 25 17:48:56 user nova-compute[74739]:   </metadata>
Oct 25 17:48:56 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:48:56 user nova-compute[74739]:     <system>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="serial">bdcd3887-b9d6-42f3-b758-1410e22af542</entry>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="uuid">bdcd3887-b9d6-42f3-b758-1410e22af542</entry>
Oct 25 17:48:56 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:48:56 user nova-compute[74739]:     </system>
Oct 25 17:48:56 user nova-compute[74739]:   </sysinfo>
Oct 25 17:48:56 user nova-compute[74739]:   <os>
Oct 25 17:48:56 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:48:56 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:48:56 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:48:56 user nova-compute[74739]:   </os>
Oct 25 17:48:56 user nova-compute[74739]:   <features>
Oct 25 17:48:56 user nova-compute[74739]:     <acpi/>
Oct 25 17:48:56 user nova-compute[74739]:     <apic/>
Oct 25 17:48:56 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:48:56 user nova-compute[74739]:   </features>
Oct 25 17:48:56 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:48:56 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:48:56 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:48:56 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:48:56 user nova-compute[74739]:   </clock>
Oct 25 17:48:56 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:48:56 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:48:56 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:48:56 user nova-compute[74739]:   </cpu>
Oct 25 17:48:56 user nova-compute[74739]:   <devices>
Oct 25 17:48:56 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:48:56 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:48:56 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk"/>
Oct 25 17:48:56 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:48:56 user nova-compute[74739]:     </disk>
Oct 25 17:48:56 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:48:56 user nova-compute[74739]:       <mac address="fa:16:3e:ad:71:5d"/>
Oct 25 17:48:56 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:56 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:48:56 user nova-compute[74739]:       <target dev="tapfab33d97-c0"/>
Oct 25 17:48:56 user nova-compute[74739]:     </interface>
Oct 25 17:48:56 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:48:56 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/console.log" append="off"/>
Oct 25 17:48:56 user nova-compute[74739]:     </serial>
Oct 25 17:48:56 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:48:56 user nova-compute[74739]:     <video>
Oct 25 17:48:56 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:48:56 user nova-compute[74739]:     </video>
Oct 25 17:48:56 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:48:56 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:48:56 user nova-compute[74739]:     </rng>
Oct 25 17:48:56 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:48:56 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:48:56 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:48:56 user nova-compute[74739]:     </memballoon>
Oct 25 17:48:56 user nova-compute[74739]:   </devices>
Oct 25 17:48:56 user nova-compute[74739]: </domain>
Oct 25 17:48:56 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1887983099',display_name='tempest-VolumesSnapshotTestJSON-instance-1887983099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1887983099',id=10,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgSk72kfnBLo7p1zeXIL+vNdelFDzc7Jz8d9B7GqSAfBuHsH6tHlFrFumZI281dlSZTxR6AInaRpfSMI2A+E3XGZkn8lESWzGN60dfbjwuyuhGRvaYIjdLuYcaPDsxNhg==',key_name='tempest-keypair-2016874935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-3w1tmzls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=bdcd3887-b9d6-42f3-b758-1410e22af542,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG os_vif [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae1b35e8-7629-54d4-a65d-ed01b7f36abb', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfab33d97-c0, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfab33d97-c0, col_values=(('qos', UUID('847dc0ff-ddb8-404a-9d3e-8ff5a3d5db6b')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfab33d97-c0, col_values=(('external_ids', {'iface-id': 'fab33d97-c0af-43d1-bea2-5b862371e93e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:71:5d', 'vm-uuid': 'bdcd3887-b9d6-42f3-b758-1410e22af542'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:56 user nova-compute[74739]: INFO os_vif [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0')
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No VIF found with MAC fa:16:3e:ad:71:5d, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updated VIF entry in instance network info cache for port fab33d97-c0af-43d1-bea2-5b862371e93e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating instance_info_cache with network_info: [{"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc81c884-bf99-45bd-8dcd-b0a9bfea1793 req-dd6df5b4-6524-4201-970c-6b2af88cfabc service nova] Releasing lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Acquiring lock "c163977d-edab-4396-a273-d015f01077ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "c163977d-edab-4396-a273-d015f01077ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received event network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] No waiting events found dispatching network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:48:58 user nova-compute[74739]: WARNING nova.compute.manager [req-786e2590-b9d3-4fcb-8aa4-dda22cc99273 req-8314d715-6731-4ae9-9f45-b4539bc68cd4 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received unexpected event network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e for instance with vm_state building and task_state spawning.
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:48:58 user nova-compute[74739]: INFO nova.compute.claims [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Claim successful on node user
Oct 25 17:48:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:48:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:48:58 user nova-compute[74739]: INFO nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Booting with volume e7aa421d-23be-4e20-bbe2-bb210cfb0617 at /dev/vda
Oct 25 17:48:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG nova.policy [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04b9de01973b4f9ca8cdb3975af113d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfafdc8291b64ee49ca5e0edf4b910b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:48:58 user nova-compute[74739]: DEBUG os_brick.utils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:48:58 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpgr5694dc/privsep.sock']
Oct 25 17:48:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:48:59 user sudo[86110]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpgr5694dc/privsep.sock
Oct 25 17:48:59 user sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 25 17:48:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully created port: 03edbd4f-cd17-40a2-a8b2-5d78bca0a23e {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:48:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully created port: 4b652291-f061-4f61-8144-5b251ba5093a {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:49:00 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Instance spawned successfully.
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received event network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] No waiting events found dispatching network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:49:00 user nova-compute[74739]: WARNING nova.compute.manager [req-c1b765d0-ebca-4da4-be3f-0cfdcf41b4f7 req-78cb69fc-93b9-40f6-a8a7-559e6ed76668 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received unexpected event network-vif-plugged-fab33d97-c0af-43d1-bea2-5b862371e93e for instance with vm_state building and task_state spawning.
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:49:00 user nova-compute[74739]: INFO nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Took 5.44 seconds to spawn the instance on the hypervisor.
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:49:00 user nova-compute[74739]: INFO nova.compute.manager [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Took 6.26 seconds to build instance.
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-809b6b69-27cb-4190-865d-fd4d1887b3cf tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.362s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully created port: ad69b179-9621-47d7-82a2-5f0fb1a45eee {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:49:00 user sudo[86110]: pam_unix(sudo:session): session closed for user root
Oct 25 17:49:00 user nova-compute[74739]: INFO oslo.privsep.daemon [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Spawned new privsep daemon via rootwrap
Oct 25 17:49:00 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 25 17:49:00 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 25 17:49:00 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 25 17:49:00 user nova-compute[74739]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86127
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[358ba7a3-9190-444a-b80d-9f4a1f5a9d91]: (2,) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:00 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[829f280d-a817-4449-9cb7-e22b9fefae4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:01 user nova-compute[74739]: WARNING os_brick.initiator.connectors.nvmeof [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c390033-74b3-44cb-acdc-e5bb95ece1f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ffa6e-c987-42f3-ad2c-161ba9d0ec7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee10478-0759-48f3-8b78-bbc0e11aaef3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:01 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1be79-a741-4b71-a0da-17a582a089f4]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG os_brick.utils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] <== get_connector_properties: return (2233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating existing volume attachment record: 38c5a721-bd6e-4b3d-91aa-6d4b280e138e {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully created port: 2be0d4ee-c382-4fd1-994b-aa3d99c5ba18 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully created port: f63f91f6-aee5-4490-96fd-416845a60d85 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: 03edbd4f-cd17-40a2-a8b2-5d78bca0a23e {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-03edbd4f-cd17-40a2-a8b2-5d78bca0a23e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-03edbd4f-cd17-40a2-a8b2-5d78bca0a23e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port 03edbd4f-cd17-40a2-a8b2-5d78bca0a23e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62f30271-0621-4dff-bf56-493d4c780561 req-fef70876-34eb-4bcb-93c5-9cb99553b43c service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: 463d3705-5caf-404b-949b-e1b418885269 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: 9c9bcd3f-ce42-4791-a76a-b36b8b1fba67 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: 4b652291-f061-4f61-8144-5b251ba5093a {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-463d3705-5caf-404b-949b-e1b418885269 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-463d3705-5caf-404b-949b-e1b418885269. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port 463d3705-5caf-404b-949b-e1b418885269 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-9c9bcd3f-ce42-4791-a76a-b36b8b1fba67 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-9c9bcd3f-ce42-4791-a76a-b36b8b1fba67. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port 9c9bcd3f-ce42-4791-a76a-b36b8b1fba67 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: ad69b179-9621-47d7-82a2-5f0fb1a45eee {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-4b652291-f061-4f61-8144-5b251ba5093a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-4b652291-f061-4f61-8144-5b251ba5093a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port 4b652291-f061-4f61-8144-5b251ba5093a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:05 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:49:05 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7164MB free_disk=25.50146484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:05 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: 2be0d4ee-c382-4fd1-994b-aa3d99c5ba18 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 78ae4728-74df-4d51-b3ad-c550f2e95850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance a8d9aaf2-caff-47c9-9add-1963381511d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 018d4427-32ef-4091-ae80-d30d33785609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 04153d63-4a29-4ecc-97b3-e557868a8a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c25ffdb2-6a06-4901-a454-02e6a379bffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bdcd3887-b9d6-42f3-b758-1410e22af542 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c163977d-edab-4396-a273-d015f01077ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.network.neutron [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b513c5b-c9f4-4dc9-9434-3a6b849f035b req-7d12df11-1d24-4169-b3cb-279c4eb33649 service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-ad69b179-9621-47d7-82a2-5f0fb1a45eee {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-ad69b179-9621-47d7-82a2-5f0fb1a45eee. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port ad69b179-9621-47d7-82a2-5f0fb1a45eee {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Successfully updated port: f63f91f6-aee5-4490-96fd-416845a60d85 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-2be0d4ee-c382-4fd1-994b-aa3d99c5ba18 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-2be0d4ee-c382-4fd1-994b-aa3d99c5ba18. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port 2be0d4ee-c382-4fd1-994b-aa3d99c5ba18 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a525c15e-1d4d-4896-a23c-2960001df235 req-c00731cf-cb7f-47d9-abd5-621fa56c4071 service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:49:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Received event network-changed-f63f91f6-aee5-4490-96fd-416845a60d85 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing instance network info cache due to event network-changed-f63f91f6-aee5-4490-96fd-416845a60d85. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] Acquiring lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [{"id": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "address": "fa:16:3e:a9:f7:fa", "network": {"id": "9a955b88-346e-4cbd-bbdb-9644369f7d9f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1735152363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03edbd4f-cd", "ovs_interfaceid": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "463d3705-5caf-404b-949b-e1b418885269", "address": "fa:16:3e:50:5f:13", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463d3705-5c", "ovs_interfaceid": "463d3705-5caf-404b-949b-e1b418885269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "address": "fa:16:3e:fb:c0:e8", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9bcd3f-ce", "ovs_interfaceid": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b652291-f061-4f61-8144-5b251ba5093a", "address": "fa:16:3e:52:33:31", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b652291-f0", "ovs_interfaceid": "4b652291-f061-4f61-8144-5b251ba5093a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "address": "fa:16:3e:45:38:88", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69b179-96", "ovs_interfaceid": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "address": "fa:16:3e:b6:6f:a3", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be0d4ee-c3", "ovs_interfaceid": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f63f91f6-aee5-4490-96fd-416845a60d85", "address": "fa:16:3e:42:5a:ff", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63f91f6-ae", "ovs_interfaceid": "f63f91f6-aee5-4490-96fd-416845a60d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance network_info: |[{"id": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "address": "fa:16:3e:a9:f7:fa", "network": {"id": "9a955b88-346e-4cbd-bbdb-9644369f7d9f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1735152363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03edbd4f-cd", "ovs_interfaceid": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "463d3705-5caf-404b-949b-e1b418885269", "address": "fa:16:3e:50:5f:13", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463d3705-5c", "ovs_interfaceid": "463d3705-5caf-404b-949b-e1b418885269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "address": "fa:16:3e:fb:c0:e8", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9bcd3f-ce", "ovs_interfaceid": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b652291-f061-4f61-8144-5b251ba5093a", "address": "fa:16:3e:52:33:31", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b652291-f0", "ovs_interfaceid": "4b652291-f061-4f61-8144-5b251ba5093a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "address": "fa:16:3e:45:38:88", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69b179-96", "ovs_interfaceid": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "address": "fa:16:3e:b6:6f:a3", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be0d4ee-c3", "ovs_interfaceid": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f63f91f6-aee5-4490-96fd-416845a60d85", "address": "fa:16:3e:42:5a:ff", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63f91f6-ae", "ovs_interfaceid": "f63f91f6-aee5-4490-96fd-416845a60d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:49:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] Acquired lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:09 user nova-compute[74739]: DEBUG nova.network.neutron [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Refreshing network info cache for port f63f91f6-aee5-4490-96fd-416845a60d85 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updated VIF entry in instance network info cache for port f63f91f6-aee5-4490-96fd-416845a60d85. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [{"id": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "address": "fa:16:3e:a9:f7:fa", "network": {"id": "9a955b88-346e-4cbd-bbdb-9644369f7d9f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1735152363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03edbd4f-cd", "ovs_interfaceid": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "463d3705-5caf-404b-949b-e1b418885269", "address": "fa:16:3e:50:5f:13", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463d3705-5c", "ovs_interfaceid": "463d3705-5caf-404b-949b-e1b418885269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "address": "fa:16:3e:fb:c0:e8", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9bcd3f-ce", "ovs_interfaceid": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b652291-f061-4f61-8144-5b251ba5093a", "address": "fa:16:3e:52:33:31", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b652291-f0", "ovs_interfaceid": "4b652291-f061-4f61-8144-5b251ba5093a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "address": "fa:16:3e:45:38:88", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69b179-96", "ovs_interfaceid": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "address": "fa:16:3e:b6:6f:a3", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be0d4ee-c3", "ovs_interfaceid": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f63f91f6-aee5-4490-96fd-416845a60d85", "address": "fa:16:3e:42:5a:ff", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63f91f6-ae", "ovs_interfaceid": "f63f91f6-aee5-4490-96fd-416845a60d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c5fe4b1-ba88-47f9-9e3e-3afe23f4d10a req-38ff41f3-8c93-46ef-9297-619f601bb52e service nova] Releasing lock "refresh_cache-c163977d-edab-4396-a273-d015f01077ca" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lazy-loading 'flavor' on Instance uuid 78ae4728-74df-4d51-b3ad-c550f2e95850 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:10 user nova-compute[74739]: INFO nova.compute.manager [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Attaching volume 27d52e5a-90ba-4d67-a655-3694d90c10d3 to /dev/vdb
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.utils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d160db-ecda-4ee6-bb20-d49086cd4d40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b660eb-9cfc-4d79-8e94-951241ff8afc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfee4e7f-a829-4b63-9c9a-05d28b48ae05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb321e8c-0564-43a4-be10-8ca006c8bde5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:11 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d82c49-ed5d-41de-a6a8-f22ad9380861]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG os_brick.utils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating existing volume attachment record: 26e3c914-dd26-4e3c-bbc9-b315a2dd3b75 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:49:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:49:12 user nova-compute[74739]: INFO nova.compute.manager [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] instance snapshotting
Oct 25 17:49:12 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Beginning live snapshot process
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0.delta 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0.delta 1073741824" returned: 0 in 0.048s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 17:49:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74739) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 25 17:49:13 user nova-compute[74739]: INFO nova.virt.libvirt.host [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] UEFI support detected
Oct 25 17:49:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:49:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:49:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 17:49:15 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:49:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0.delta /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0.delta /opt/stack/data/nova/instances/snapshots/tmpnvm0ugku/5b0e31f113e34f97843d7520465b7ca0" returned: 0 in 0.394s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Snapshot extracted, beginning image upload
Oct 25 17:49:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing instance network info cache due to event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:17 user nova-compute[74739]: DEBUG nova.network.neutron [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing instance network info cache due to event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.network.neutron [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.network.neutron [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updated VIF entry in instance network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.network.neutron [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64c4d2bb-c833-46b4-9c34-22f7204684dc req-57733baa-2c45-4981-9149-2fb35f568fca service nova] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-changed-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Refreshing instance network info cache due to event network-changed-1a7792b1-73e4-43a3-b106-01d131c00444. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:18 user nova-compute[74739]: DEBUG nova.network.neutron [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Refreshing network info cache for port 1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updated VIF entry in instance network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9fed8386-d8e3-45f7-aa86-bea0d7785393 req-2ef57a05-1b99-48fd-80d7-4dc8b597eb86 service nova] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Snapshot image upload complete
Oct 25 17:49:19 user nova-compute[74739]: INFO nova.compute.manager [None req-702704fc-1e4b-40ec-8b99-49f26ecc05b9 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Took 6.44 seconds to snapshot the instance on the hypervisor.
Oct 25 17:49:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updated VIF entry in instance network info cache for port 1a7792b1-73e4-43a3-b106-01d131c00444. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a7c024c4-feef-424f-a0e3-2a6de75a48b6 req-7607ed36-1f14-4e7d-bf81-e1f46c2b643e service nova] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:49:20 user nova-compute[74739]: INFO nova.compute.manager [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] instance snapshotting
Oct 25 17:49:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Beginning live snapshot process
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.264s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707.delta 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707.delta 1073741824" returned: 0 in 0.049s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:21 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 17:49:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:49:22 user nova-compute[74739]: INFO nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Booting with volume 074b7fca-674a-493f-9ce3-9f0df30fb042 at /dev/vdb
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.utils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c44df8-8aec-4fa8-96b5-d04f95f1698a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c2075-9d8d-45b7-8eb3-b8f642d5c4cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e29d94a-55a7-480b-8355-e74719266856]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda9a5d1-e4d2-462f-8093-5dc47d39c834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:22 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a62e11-f48d-433f-b30f-a60bfe3792f8]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG os_brick.utils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating existing volume attachment record: 9f622e48-771a-430b-ab7d-3a5746159b9a {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:49:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 17:49:22 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707.delta /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707.delta /opt/stack/data/nova/instances/snapshots/tmpcgq701dc/180709a8f30140b8ae96c2f5b015f707" returned: 0 in 0.292s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Snapshot extracted, beginning image upload
Oct 25 17:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:24 user nova-compute[74739]: INFO nova.compute.manager [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Shelving
Oct 25 17:49:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:49:25 user nova-compute[74739]: WARNING nova.compute.manager [req-552df16d-47c7-42ec-9121-97a89fb57296 req-73ab4dac-7133-42ae-912c-0cbb82bf11d4 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state active and task_state shelving.
Oct 25 17:49:25 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Snapshot image upload complete
Oct 25 17:49:25 user nova-compute[74739]: INFO nova.compute.manager [None req-be54d5ae-cb1c-46d7-ac3c-fe3e74648165 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Took 5.92 seconds to snapshot the instance on the hypervisor.
Oct 25 17:49:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance destroyed successfully.
Oct 25 17:49:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Beginning cold snapshot process
Oct 25 17:49:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:26 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:49:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk /opt/stack/data/nova/instances/snapshots/tmp4a468u6j/a53c150db7e1464c9cb194d2c4e60451 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk /opt/stack/data/nova/instances/snapshots/tmp4a468u6j/a53c150db7e1464c9cb194d2c4e60451" returned: 0 in 0.628s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Snapshot extracted, beginning image upload
Oct 25 17:49:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:49:27 user nova-compute[74739]: WARNING nova.compute.manager [req-5280ce4c-8a21-42fa-aac7-5b1ff86389b0 req-ecc829d5-e637-4f31-a160-cdab162e47a8 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 17:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connector [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Factory for ISCSI on None {{(pid=74739) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoTxjuqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:49:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:49:30 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ae860f-b539-4344-82d5-59f8043feddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:49:30 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da236b1-0bce-4917-979a-5dfec6932dfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3] added
Oct 25 17:49:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Snapshot image upload complete
Oct 25 17:49:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[58888d35-d152-459a-9228-b98ce6b31024]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59b2dcd-5229-4023-bc7e-ba3540d4ea1a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoTxjuqv {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UoTxjuqv" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13595d6-5232-47b2-b9eb-7fbcd66c1043]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UoTxjuqv'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabc1bf-0568-46f4-a6ca-690ca97c0551]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ca0cb-b2ce-4670-9eb1-fa4eac74df4b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 17:49:30 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 17:49:30 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:49:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 17:49:30 user nova-compute[74739]: 
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: INFO nova.compute.manager [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Shelve offloading
Oct 25 17:49:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance destroyed successfully.
Oct 25 17:49:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb92c06-2990-4131-ab34-8c9fd88210c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260]
Oct 25 17:49:30 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260] successful.
Oct 25 17:49:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6498fd73-edb0-4505-974a-a4a0eea87e5d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[304aa96f-2f4f-4f76-8368-08e4bff67c30]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)
Oct 25 17:49:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)
Oct 25 17:49:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c5457-e70e-4cc4-9e3b-6df68437ef6f]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoTxjuqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance destroyed successfully.
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'resources' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOGwq+E25o3BF77wQI0+sGO22Qpe+iGvi5TaQSpJ2H+kXA6GjlXZjWZzf5GK4BFKu1xMTxPYdVEVeYc5XJVLgHTXy0kDO+/Qq3weG65sLCAhFYmOuur3zQhMOQ7KJ7b5Q==',key_name='tempest-keypair-770018984',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:49:30.146004',shelved_host='user',shelved_image_id='93912557-d520-495a-a221-36c6b412b353'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:49:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG os_vif [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing instance network info cache due to event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80d38ac3-dd, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01534bde-8613-480e-b37f-3b9df2f9aa5c) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:49:31 user nova-compute[74739]: INFO os_vif [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd')
Oct 25 17:49:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Deleting instance files /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5_del
Oct 25 17:49:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Deletion of /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5_del complete
Oct 25 17:49:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26438383632363363', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438383632363363', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lazy-loading 'flavor' on Instance uuid 78ae4728-74df-4d51-b3ad-c550f2e95850 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:31 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Deleted allocations for instance a8d9aaf2-caff-47c9-9add-1963381511d5
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:49:31 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:49:31 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 17:49:31 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:49:31 user nova-compute[74739]:   <serial>27d52e5a-90ba-4d67-a655-3694d90c10d3</serial>
Oct 25 17:49:31 user nova-compute[74739]: </disk>
Oct 25 17:49:31 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'numa_topology' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.objects.base [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<a8d9aaf2-caff-47c9-9add-1963381511d5> lazy-loaded attributes: resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updated VIF entry in instance network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d773f96-f681-493d-8dcc-a1b4accbcb37 req-73a126c4-2300-4593-ae54-9aae1482be81 service nova] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] No VIF found with MAC fa:16:3e:d0:fb:f7, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:49:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7765bb1-bb9d-4687-9598-4e4ae04f886f tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.065s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5f76466e-d6a4-47c2-8359-41ca2434f12a tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.109s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:33 user nova-compute[74739]: INFO nova.compute.manager [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Terminating instance
Oct 25 17:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-unplugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] No waiting events found dispatching network-vif-unplugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d799b5a-9fb1-4b7f-beb8-c79bde9c4324 req-398b07bc-8ab5-484a-9b0e-442b4c21848c service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-unplugged-c16be41b-c787-476d-932d-62a8dcc0d188 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:49:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Instance destroyed successfully.
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lazy-loading 'resources' on Instance uuid 78ae4728-74df-4d51-b3ad-c550f2e95850 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1616510399',display_name='tempest-DeleteServersTestJSON-server-1616510399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1616510399',id=1,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa0fe25d51d457295b528c926271159',ramdisk_id='',reservation_id='r-k5d6hovw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-881344941',owner_user_name='tempest-DeleteServersTestJSON-881344941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:47:27Z,user_data=None,user_id='9062c96920c34828b8a43f2460f2e0d5',uuid=78ae4728-74df-4d51-b3ad-c550f2e95850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converting VIF {"id": "c16be41b-c787-476d-932d-62a8dcc0d188", "address": "fa:16:3e:d0:fb:f7", "network": {"id": "2afc7074-237a-414c-84e7-846561148341", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1319452539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa0fe25d51d457295b528c926271159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16be41b-c7", "ovs_interfaceid": "c16be41b-c787-476d-932d-62a8dcc0d188", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_vif [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc16be41b-c7, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5a09ed6-8da3-410d-89f6-f7b9d0ba294e) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: INFO os_vif [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:fb:f7,bridge_name='br-int',has_traffic_filtering=True,id=c16be41b-c787-476d-932d-62a8dcc0d188,network=Network(2afc7074-237a-414c-84e7-846561148341),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16be41b-c7')
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UoTxjuqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340396e-216b-4023-86c0-b5857fae8d03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:49:34 user nova-compute[74739]: No targets found.
Oct 25 17:49:34 user nova-compute[74739]: iSNS:
Oct 25 17:49:34 user nova-compute[74739]: No targets found.
Oct 25 17:49:34 user nova-compute[74739]: STATIC:
Oct 25 17:49:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3
Oct 25 17:49:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:49:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:49:34 user nova-compute[74739]: FIRMWARE:
Oct 25 17:49:34 user nova-compute[74739]: No targets found.
Oct 25 17:49:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:49:34 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:49:34 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c3576-4c8c-48de-922b-1086e3a236df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c0bc1-e5fe-45a2-8605-1e15e035d6a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)
Oct 25 17:49:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 (non-flash)
Oct 25 17:49:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5248376e-96d9-4cc6-afaa-cfda179cc44b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9ab180-1097-4245-846e-6d767f2d2c2f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30523a7-ba72-4f13-a06d-e19a25135cc6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab05ba-f1e0-42e4-8301-ee06d161b498]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c66dd9-33f6-42ab-b1d6-a35421d19433]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a759f-dff6-47d5-9b55-a5e9142e74fc]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260]
Oct 25 17:49:34 user nova-compute[74739]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3, portal: 172.16.0.220,3260] successful.
Oct 25 17:49:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27d52e5a-90ba-4d67-a655-3694d90c10d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda54a95-8ed1-4cd1-bcfb-3687ae6c22c0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] <== disconnect_volume: return (309ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:49:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Deleting instance files /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850_del
Oct 25 17:49:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Deletion of /opt/stack/data/nova/instances/78ae4728-74df-4d51-b3ad-c550f2e95850_del complete
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-changed-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Refreshing instance network info cache due to event network-changed-4f316f5c-99fe-4031-8f8b-f716b70b054e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] Acquiring lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] Acquired lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Refreshing network info cache for port 4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:34 user nova-compute[74739]: INFO nova.compute.manager [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 25 17:49:34 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updated VIF entry in instance network info cache for port 4f316f5c-99fe-4031-8f8b-f716b70b054e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating instance_info_cache with network_info: [{"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-492be2ef-f4f7-4384-8b09-bd99bd5d68d8 req-ab1809ca-af7a-45f0-abe3-874286eb0ec1 service nova] Releasing lock "refresh_cache-018d4427-32ef-4091-ae80-d30d33785609" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:35 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Took 0.79 seconds to deallocate network for instance.
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5dfc9212-4d2f-4edb-ad15-ad5fb16ca9bc req-ef65dfd7-6b1b-4683-b815-2d623f22fefe service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-deleted-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:35 user nova-compute[74739]: INFO nova.compute.manager [req-5dfc9212-4d2f-4edb-ad15-ad5fb16ca9bc req-ef65dfd7-6b1b-4683-b815-2d623f22fefe service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Neutron deleted interface c16be41b-c787-476d-932d-62a8dcc0d188; detaching it from the instance and deleting it from the info cache
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-5dfc9212-4d2f-4edb-ad15-ad5fb16ca9bc req-ef65dfd7-6b1b-4683-b815-2d623f22fefe service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5dfc9212-4d2f-4edb-ad15-ad5fb16ca9bc req-ef65dfd7-6b1b-4683-b815-2d623f22fefe service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Detach interface failed, port_id=c16be41b-c787-476d-932d-62a8dcc0d188, reason: Instance 78ae4728-74df-4d51-b3ad-c550f2e95850 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] Acquiring lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] No waiting events found dispatching network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:49:35 user nova-compute[74739]: WARNING nova.compute.manager [req-69b483fa-f6cb-45d1-b255-646842000d27 req-d9517dab-b425-476a-993f-d4cb305e2afd service nova] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Received unexpected event network-vif-plugged-c16be41b-c787-476d-932d-62a8dcc0d188 for instance with vm_state active and task_state deleting.
Oct 25 17:49:36 user nova-compute[74739]: INFO nova.compute.manager [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] [instance: 78ae4728-74df-4d51-b3ad-c550f2e95850] Took 0.88 seconds to detach 1 volumes for instance.
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.volume.cinder [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Update attachment failed for attachment 9f622e48-771a-430b-ab7d-3a5746159b9a. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca] Traceback (most recent call last):
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     driver_block_device.attach_block_devices(
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     _log_and_attach(device)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     bdm.attach(*attach_args, **attach_kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     ret_val = method(obj, context, *args, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     self._do_attach(context, instance, volume, volume_api,
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     self._volume_attach(context, volume, connector, instance,
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     connection_info = volume_api.attachment_update(
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     res = method(self, ctx, *args, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     with excutils.save_and_reraise_exception():
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     self.force_reraise()
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     raise self.value
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     return method.func(obj, *args, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     resp = self._update('/attachments/%s' % id, body)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     return self.request(url, method, **kwargs)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca]     raise exceptions.from_response(resp, body)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8)
Oct 25 17:49:36 user nova-compute[74739]: ERROR nova.compute.manager [instance: c163977d-edab-4396-a273-d015f01077ca] 
Oct 25 17:49:36 user nova-compute[74739]: DEBUG nova.compute.claims [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Aborting claim: <nova.compute.claims.Claim object at 0x7fd2ec24fa90> {{(pid=74739) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.126s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:36 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Deleted allocations for instance 78ae4728-74df-4d51-b3ad-c550f2e95850
Oct 25 17:49:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-edf6c516-79c8-4eef-963a-593432ad47ab tempest-DeleteServersTestJSON-881344941 tempest-DeleteServersTestJSON-881344941-project-member] Lock "78ae4728-74df-4d51-b3ad-c550f2e95850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.519s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.422s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Build of instance c163977d-edab-4396-a273-d015f01077ca aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8) {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.utils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Build of instance c163977d-edab-4396-a273-d015f01077ca aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74739) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 25 17:49:37 user nova-compute[74739]: ERROR nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Build of instance c163977d-edab-4396-a273-d015f01077ca aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8): nova.exception.BuildAbortException: Build of instance c163977d-edab-4396-a273-d015f01077ca aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3a8d0171-1123-4562-9886-ea40cfbd33f8)
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Unplugging VIFs for instance {{(pid=74739) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "address": "fa:16:3e:a9:f7:fa", "network": {"id": "9a955b88-346e-4cbd-bbdb-9644369f7d9f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1735152363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03edbd4f-cd", "ovs_interfaceid": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "address": "fa:16:3e:a9:f7:fa", "network": {"id": "9a955b88-346e-4cbd-bbdb-9644369f7d9f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1735152363-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03edbd4f-cd", "ovs_interfaceid": "03edbd4f-cd17-40a2-a8b2-5d78bca0a23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f7:fa,bridge_name='br-int',has_traffic_filtering=True,id=03edbd4f-cd17-40a2-a8b2-5d78bca0a23e,network=Network(9a955b88-346e-4cbd-bbdb-9644369f7d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03edbd4f-cd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f7:fa,bridge_name='br-int',has_traffic_filtering=True,id=03edbd4f-cd17-40a2-a8b2-5d78bca0a23e,network=Network(9a955b88-346e-4cbd-bbdb-9644369f7d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03edbd4f-cd') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03edbd4f-cd, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:f7:fa,bridge_name='br-int',has_traffic_filtering=True,id=03edbd4f-cd17-40a2-a8b2-5d78bca0a23e,network=Network(9a955b88-346e-4cbd-bbdb-9644369f7d9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03edbd4f-cd')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463d3705-5caf-404b-949b-e1b418885269", "address": "fa:16:3e:50:5f:13", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463d3705-5c", "ovs_interfaceid": "463d3705-5caf-404b-949b-e1b418885269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "463d3705-5caf-404b-949b-e1b418885269", "address": "fa:16:3e:50:5f:13", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463d3705-5c", "ovs_interfaceid": "463d3705-5caf-404b-949b-e1b418885269", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:5f:13,bridge_name='br-int',has_traffic_filtering=True,id=463d3705-5caf-404b-949b-e1b418885269,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap463d3705-5c') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:5f:13,bridge_name='br-int',has_traffic_filtering=True,id=463d3705-5caf-404b-949b-e1b418885269,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap463d3705-5c') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap463d3705-5c, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:5f:13,bridge_name='br-int',has_traffic_filtering=True,id=463d3705-5caf-404b-949b-e1b418885269,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap463d3705-5c')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "address": "fa:16:3e:fb:c0:e8", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9bcd3f-ce", "ovs_interfaceid": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "address": "fa:16:3e:fb:c0:e8", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c9bcd3f-ce", "ovs_interfaceid": "9c9bcd3f-ce42-4791-a76a-b36b8b1fba67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9c9bcd3f-ce42-4791-a76a-b36b8b1fba67,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c9bcd3f-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9c9bcd3f-ce42-4791-a76a-b36b8b1fba67,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c9bcd3f-ce') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c9bcd3f-ce, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:c0:e8,bridge_name='br-int',has_traffic_filtering=True,id=9c9bcd3f-ce42-4791-a76a-b36b8b1fba67,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9c9bcd3f-ce')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b652291-f061-4f61-8144-5b251ba5093a", "address": "fa:16:3e:52:33:31", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b652291-f0", "ovs_interfaceid": "4b652291-f061-4f61-8144-5b251ba5093a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "4b652291-f061-4f61-8144-5b251ba5093a", "address": "fa:16:3e:52:33:31", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b652291-f0", "ovs_interfaceid": "4b652291-f061-4f61-8144-5b251ba5093a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:33:31,bridge_name='br-int',has_traffic_filtering=True,id=4b652291-f061-4f61-8144-5b251ba5093a,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b652291-f0') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:33:31,bridge_name='br-int',has_traffic_filtering=True,id=4b652291-f061-4f61-8144-5b251ba5093a,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b652291-f0') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b652291-f0, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:33:31,bridge_name='br-int',has_traffic_filtering=True,id=4b652291-f061-4f61-8144-5b251ba5093a,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b652291-f0')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "address": "fa:16:3e:45:38:88", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69b179-96", "ovs_interfaceid": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "address": "fa:16:3e:45:38:88", "network": {"id": "9180081e-e3b7-44df-bf44-898fe3ef2e43", "bridge": "br-int", "label": "tempest-device-tagging-net1-1087814676", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.212", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69b179-96", "ovs_interfaceid": "ad69b179-9621-47d7-82a2-5f0fb1a45eee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:88,bridge_name='br-int',has_traffic_filtering=True,id=ad69b179-9621-47d7-82a2-5f0fb1a45eee,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69b179-96') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:88,bridge_name='br-int',has_traffic_filtering=True,id=ad69b179-9621-47d7-82a2-5f0fb1a45eee,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69b179-96') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad69b179-96, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:38:88,bridge_name='br-int',has_traffic_filtering=True,id=ad69b179-9621-47d7-82a2-5f0fb1a45eee,network=Network(9180081e-e3b7-44df-bf44-898fe3ef2e43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69b179-96')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "address": "fa:16:3e:b6:6f:a3", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be0d4ee-c3", "ovs_interfaceid": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "address": "fa:16:3e:b6:6f:a3", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2be0d4ee-c3", "ovs_interfaceid": "2be0d4ee-c382-4fd1-994b-aa3d99c5ba18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=2be0d4ee-c382-4fd1-994b-aa3d99c5ba18,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be0d4ee-c3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=2be0d4ee-c382-4fd1-994b-aa3d99c5ba18,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be0d4ee-c3') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2be0d4ee-c3, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6f:a3,bridge_name='br-int',has_traffic_filtering=True,id=2be0d4ee-c382-4fd1-994b-aa3d99c5ba18,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2be0d4ee-c3')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-874771855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-874771855',id=11,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ3pthsQHPe4yxuovyqWwMuPbREH0SCTt23WprNKDgS34s52Gdq0feFkbcZaB8gI5R+bhLz7DV5VeCswCbskTbOJlVMiZtKmKMMT1Bpk4fQfFWXLrdylezgiH8ccqAHIQ==',key_name='tempest-keypair-975155256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfafdc8291b64ee49ca5e0edf4b910b9',ramdisk_id='',reservation_id='r-6yo32pzm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1914022205',owner_user_name='tempest-TaggedBootDevicesTest_v242-1914022205-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:48:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b9de01973b4f9ca8cdb3975af113d4',uuid=c163977d-edab-4396-a273-d015f01077ca,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f63f91f6-aee5-4490-96fd-416845a60d85", "address": "fa:16:3e:42:5a:ff", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63f91f6-ae", "ovs_interfaceid": "f63f91f6-aee5-4490-96fd-416845a60d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converting VIF {"id": "f63f91f6-aee5-4490-96fd-416845a60d85", "address": "fa:16:3e:42:5a:ff", "network": {"id": "d3aa9e93-d1b5-4214-b265-ddeff70916b1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1246117775", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cfafdc8291b64ee49ca5e0edf4b910b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf63f91f6-ae", "ovs_interfaceid": "f63f91f6-aee5-4490-96fd-416845a60d85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:5a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f63f91f6-aee5-4490-96fd-416845a60d85,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63f91f6-ae') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f63f91f6-aee5-4490-96fd-416845a60d85,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63f91f6-ae') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf63f91f6-ae, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:49:37 user nova-compute[74739]: INFO os_vif [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:5a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f63f91f6-aee5-4490-96fd-416845a60d85,network=Network(d3aa9e93-d1b5-4214-b265-ddeff70916b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf63f91f6-ae')
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Unplugged VIFs for instance {{(pid=74739) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:49:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:49:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:40 user nova-compute[74739]: INFO nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Took 2.89 seconds to deallocate network for instance.
Oct 25 17:49:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume: e7aa421d-23be-4e20-bbe2-bb210cfb0617 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 25 17:49:40 user nova-compute[74739]: INFO nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume e7aa421d-23be-4e20-bbe2-bb210cfb0617
Oct 25 17:49:40 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Skipping driver_detach during remote rebuild. {{(pid=74739) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lazy-loading 'flavor' on Instance uuid 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:40 user nova-compute[74739]: INFO nova.compute.manager [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Attaching volume 3f6ea651-3076-4023-9967-1a870374c5c1 to /dev/sdc
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.utils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4150550e-c984-42f3-8f27-c14da77ac72f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd3104-a936-4893-b63c-c294233ca505]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d74510-1771-4d30-a758-f9601cab85b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256240c-3c19-4fce-93be-7510e35a8891]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:40 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01177d-f845-4305-9c32-6a7c508901cc]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG os_brick.utils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:40 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating existing volume attachment record: 0ac4163f-5cbe-4359-bbac-f903eaaa46fa {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:41 user nova-compute[74739]: WARNING nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Failed to detach volume: e7aa421d-23be-4e20-bbe2-bb210cfb0617 due to 'NoneType' object has no attribute 'devices'
Oct 25 17:49:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume: 074b7fca-674a-493f-9ce3-9f0df30fb042 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 25 17:49:41 user nova-compute[74739]: INFO nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume 074b7fca-674a-493f-9ce3-9f0df30fb042
Oct 25 17:49:41 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Skipping driver_detach during remote rebuild. {{(pid=74739) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 25 17:49:41 user nova-compute[74739]: WARNING nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Failed to detach volume: 074b7fca-674a-493f-9ce3-9f0df30fb042 due to 'NoneType' object has no attribute 'devices'
Oct 25 17:49:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume: 88a2daa6-2467-46a4-8b60-08e4817a1173 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 25 17:49:41 user nova-compute[74739]: INFO nova.compute.manager [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Detaching volume 88a2daa6-2467-46a4-8b60-08e4817a1173
Oct 25 17:49:41 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] [instance: c163977d-edab-4396-a273-d015f01077ca] Skipping driver_detach during remote rebuild. {{(pid=74739) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 25 17:49:41 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Deleted allocations for instance c163977d-edab-4396-a273-d015f01077ca
Oct 25 17:49:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d45e49a2-9254-47c9-ad63-7f17d55fbf9a tempest-TaggedBootDevicesTest_v242-1914022205 tempest-TaggedBootDevicesTest_v242-1914022205-project-member] Lock "c163977d-edab-4396-a273-d015f01077ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.679s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-changed-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Refreshing instance network info cache due to event network-changed-8ef64567-0d19-4a6a-86a7-22a37ef0c882. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] Acquiring lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] Acquired lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:47 user nova-compute[74739]: DEBUG nova.network.neutron [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Refreshing network info cache for port 8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lazy-loading 'flavor' on Instance uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updated VIF entry in instance network info cache for port 8ef64567-0d19-4a6a-86a7-22a37ef0c882. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updating instance_info_cache with network_info: [{"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6e318cc9-f377-4995-b229-fb22e8b71df8 req-53a9ebb0-f106-4c1a-8f4e-3441cc78b760 service nova] Releasing lock "refresh_cache-59ca18ab-9b5c-4738-b9f6-955dc6e48be8" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:48 user nova-compute[74739]: INFO nova.compute.manager [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Attaching volume 3a3f252a-f91d-4ee4-9158-7232c97b388c to /dev/vdb
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e3683-6ce4-43ed-bf6f-3d5d9ccde6a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b56886-c9f0-49de-ad07-d7b412c7b6f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c5b96d-25e5-41ff-9096-e2c0c36487ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[654beab0-431d-4849-a540-294bd66bd483]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:48 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f19e92-620d-483a-b6a6-00bc3c7329f2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:48 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updating existing volume attachment record: ce364736-69b7-4b11-98b2-06cbe6ab1c62 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-changed-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Refreshing instance network info cache due to event network-changed-7e87b1fd-fdce-4810-b4c5-2690d673240b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] Acquiring lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] Acquired lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG nova.network.neutron [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Refreshing network info cache for port 7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:52 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lazy-loading 'flavor' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.533s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updated VIF entry in instance network info cache for port 7e87b1fd-fdce-4810-b4c5-2690d673240b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updating instance_info_cache with network_info: [{"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14df7b82-a4d6-4e4b-a371-5652ae102103 req-4eeb482a-db55-45fd-93ec-fc766bc0585d service nova] Releasing lock "refresh_cache-c25ffdb2-6a06-4901-a454-02e6a379bffb" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:49:53 user nova-compute[74739]: INFO nova.compute.manager [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Attaching volume 64bdec79-5ed2-4455-9e7d-e57c262ed402 to /dev/vdb
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.utils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a043f-bcb3-4cb9-af90-633a9b362617]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7691b7-c0ed-41a7-990e-c0aaacc682e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60873f-31b8-484e-94d6-e16ed44a603d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04a8095-3da2-404f-ae99-d545f08745d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:49:53 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:49:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[941df293-2fea-405a-a6e3-5e06c232dae3]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG os_brick.utils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:49:53 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updating existing volume attachment record: 3eb7bd92-9e0f-4db0-a2d3-412fcd1dfba2 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:49:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVsGWnAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:49:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:49:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:49:59 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aefdd5-db38-4a2e-8f7b-7f2099d18087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:49:59 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e1c94-736f-41e4-99ce-b3ba684bbc9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1] added
Oct 25 17:49:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c750b2-3323-4373-8840-66c91fcbf728]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9645c4e1-bba4-4ece-a831-87b540a47dd1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVsGWnAt {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVsGWnAt" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b01a2-0107-41f6-978b-b6301fcddf1d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVsGWnAt'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea79e6-3a64-4fc5-a46e-cab55126f218]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe361dc-6999-45b3-b016-6da0586bc422]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 17:49:59 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 17:49:59 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:49:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 17:49:59 user nova-compute[74739]: 
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1824cd-c9d7-408c-8430-c2be525d4462]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260]
Oct 25 17:49:59 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260] successful.
Oct 25 17:49:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e9c072-4b0a-4168-b0d8-faf3350302f0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882be4d-5764-41b7-9818-018d04e11e0f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:49:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:49:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de55789f-d1d2-41f0-8c6f-282331aa68ed]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVsGWnAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:49:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:00 user nova-compute[74739]: INFO nova.compute.manager [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Terminating instance
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23562323866376337', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562323866376337', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lazy-loading 'flavor' on Instance uuid 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:50:00 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:00 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 17:50:00 user nova-compute[74739]:   <target dev="sdc" bus="scsi"/>
Oct 25 17:50:00 user nova-compute[74739]:   <serial>3f6ea651-3076-4023-9967-1a870374c5c1</serial>
Oct 25 17:50:00 user nova-compute[74739]:   <address type="drive" controller="0" unit="2"/>
Oct 25 17:50:00 user nova-compute[74739]: </disk>
Oct 25 17:50:00 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:50:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-unplugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] No waiting events found dispatching network-vif-unplugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-d13d993c-d741-4783-a464-f42158ba8e4b req-af38f412-4e3d-42c2-809d-e9db00f7e36d service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-unplugged-057ce179-04c7-41cc-b134-04d70a56e21e for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No BDM found with device name sda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] No VIF found with MAC fa:16:3e:9b:19:7a, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f88f8f63-b964-4d9c-9e9b-ce4f77396fb3 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.693s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Instance destroyed successfully.
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.objects.instance [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lazy-loading 'resources' on Instance uuid 04153d63-4a29-4ecc-97b3-e557868a8a4a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1815133267',display_name='tempest-VolumesActionsTest-instance-1815133267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1815133267',id=7,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='efaa30b9fa074f12a9f43f3a1644916d',ramdisk_id='',reservation_id='r-77ydyxdj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1170425060',owner_user_name='tempest-VolumesActionsTest-1170425060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:48:04Z,user_data=None,user_id='8930b582ad7e43f9b431f64b51b7a14e',uuid=04153d63-4a29-4ecc-97b3-e557868a8a4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converting VIF {"id": "057ce179-04c7-41cc-b134-04d70a56e21e", "address": "fa:16:3e:ab:a2:93", "network": {"id": "6c3a8568-95b7-49d6-90f1-beaa8bbb0783", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2085890188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "efaa30b9fa074f12a9f43f3a1644916d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057ce179-04", "ovs_interfaceid": "057ce179-04c7-41cc-b134-04d70a56e21e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG os_vif [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057ce179-04, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f43dd4d-1849-4ece-b564-19f6bc1996b1) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:01 user nova-compute[74739]: INFO os_vif [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a2:93,bridge_name='br-int',has_traffic_filtering=True,id=057ce179-04c7-41cc-b134-04d70a56e21e,network=Network(6c3a8568-95b7-49d6-90f1-beaa8bbb0783),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057ce179-04')
Oct 25 17:50:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Deleting instance files /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a_del
Oct 25 17:50:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Deletion of /opt/stack/data/nova/instances/04153d63-4a29-4ecc-97b3-e557868a8a4a_del complete
Oct 25 17:50:01 user nova-compute[74739]: INFO nova.compute.manager [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:50:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-d70fcc3e-dd3e-4ed2-aacb-f1d091a67b60 req-caab9736-e427-46af-8bee-833c811e6e11 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-deleted-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.compute.manager [req-d70fcc3e-dd3e-4ed2-aacb-f1d091a67b60 req-caab9736-e427-46af-8bee-833c811e6e11 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Neutron deleted interface 057ce179-04c7-41cc-b134-04d70a56e21e; detaching it from the instance and deleting it from the info cache
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-d70fcc3e-dd3e-4ed2-aacb-f1d091a67b60 req-caab9736-e427-46af-8bee-833c811e6e11 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Took 0.61 seconds to deallocate network for instance.
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-d70fcc3e-dd3e-4ed2-aacb-f1d091a67b60 req-caab9736-e427-46af-8bee-833c811e6e11 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Detach interface failed, port_id=057ce179-04c7-41cc-b134-04d70a56e21e, reason: Instance 04153d63-4a29-4ecc-97b3-e557868a8a4a could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.compute.manager [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Detaching volume 3f6ea651-3076-4023-9967-1a870374c5c1
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.virt.block_device [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Attempting to driver detach volume 3f6ea651-3076-4023-9967-1a870374c5c1 from mountpoint /dev/sdc
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Attempting to detach device sdc from instance 018d4427-32ef-4091-ae80-d30d33785609 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:50:02 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:02 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 17:50:02 user nova-compute[74739]:   <target dev="sdc" bus="scsi"/>
Oct 25 17:50:02 user nova-compute[74739]:   <serial>3f6ea651-3076-4023-9967-1a870374c5c1</serial>
Oct 25 17:50:02 user nova-compute[74739]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 17:50:02 user nova-compute[74739]: </disk>
Oct 25 17:50:02 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Successfully detached device sdc from instance 018d4427-32ef-4091-ae80-d30d33785609 from the persistent domain config.
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 018d4427-32ef-4091-ae80-d30d33785609 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:50:02 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:02 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 17:50:02 user nova-compute[74739]:   <target dev="sdc" bus="scsi"/>
Oct 25 17:50:02 user nova-compute[74739]:   <serial>3f6ea651-3076-4023-9967-1a870374c5c1</serial>
Oct 25 17:50:02 user nova-compute[74739]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 25 17:50:02 user nova-compute[74739]: </disk>
Oct 25 17:50:02 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:02 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Deleted allocations for instance 04153d63-4a29-4ecc-97b3-e557868a8a4a
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf342990-6860-4819-b306-aa826a8c8347 tempest-VolumesActionsTest-1170425060 tempest-VolumesActionsTest-1170425060-project-member] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.110s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:02 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] Acquiring lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] Lock "04153d63-4a29-4ecc-97b3-e557868a8a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] No waiting events found dispatching network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:03 user nova-compute[74739]: WARNING nova.compute.manager [req-7891bc7e-2f4c-4064-a38c-3b13561e051b req-1ecb6f24-d900-4639-807c-963251c802a2 service nova] [instance: 04153d63-4a29-4ecc-97b3-e557868a8a4a] Received unexpected event network-vif-plugged-057ce179-04c7-41cc-b134-04d70a56e21e for instance with vm_state deleted and task_state None.
Oct 25 17:50:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:06 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:06 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=25.3966064453125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 018d4427-32ef-4091-ae80-d30d33785609 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c25ffdb2-6a06-4901-a454-02e6a379bffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bdcd3887-b9d6-42f3-b758-1410e22af542 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:50:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:50:07 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:50:07 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:50:07 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:50:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoPqufsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:08 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc90ade2-92f4-45c5-8c6b-0e2bbbdca0e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:50:08 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be8666-e285-4fb6-9f59-5c7472f57cef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c] added
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa3e80-09fc-48cd-813f-6d2863ee029f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd3c130-a1e9-4a33-a193-82b36ef3d573]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OoPqufsJ {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OoPqufsJ" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[982059fd-90f9-4633-a1f8-65e014a8b96f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OoPqufsJ'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c89f9d-da98-4382-9015-c7c501659bad]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2eea83-81f3-4e70-8096-1aa60f893be0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4debf6b-cbd6-4351-b62d-e9ee2122d4fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260]
Oct 25 17:50:08 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260] successful.
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d05844-c423-4122-9b8e-bef96e96e9ec]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef74c546-c7bb-4365-8ef2-96544c74ef0e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:08 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:08 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19c6ba1-de6b-4ff2-b817-d90569a0c93b]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:50:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoPqufsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23531643161303562', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643161303562', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lazy-loading 'flavor' on Instance uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:50:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:09 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:50:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:50:09 user nova-compute[74739]:   <serial>3a3f252a-f91d-4ee4-9158-7232c97b388c</serial>
Oct 25 17:50:09 user nova-compute[74739]: </disk>
Oct 25 17:50:09 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:50:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] No VIF found with MAC fa:16:3e:6e:2f:94, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:50:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e7ebeca2-1e96-4b44-bf43-63f5cd370278 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.895s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da45fceb-3d25-4025-ae5c-ac3117dc5b65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aa79dd-dc8d-4436-9541-0990aa4cf7dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e9ef6-1e26-481d-a96e-83d582e9e65b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd26721-625d-4958-95ea-6c65029903c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:12 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:50:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e874e0-4937-43cf-a745-deccaa420587]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:50:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:12 user nova-compute[74739]: INFO nova.compute.manager [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Swapping volume 3a3f252a-f91d-4ee4-9158-7232c97b388c for 9391917f-0988-4a94-b70d-624db34727b0
Oct 25 17:50:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pENsPeRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:13 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:13 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:13 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de72799a-3572-474d-8124-0eba1a321932]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:50:13 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cbef1e-54bd-4efe-a739-54730e831fa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402] added
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e175243-0b2e-4445-b5d3-47f88d3e50fd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2870fb0b-4c9b-4c3f-aabf-86bfa307defd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pENsPeRA {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pENsPeRA" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b20d2b1-e62c-429f-ae0b-10ddcc382a10]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pENsPeRA'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfd2d6f-27a2-48d7-abf9-5705aa01a108]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[87310d5c-00a7-42e3-bc11-b70e2a43d8ae]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b308a0e2-161a-4a70-be4e-d6771242ab8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260]
Oct 25 17:50:13 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260] successful.
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e0173-6743-4457-a07d-6b00b71d0bd2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f69193-a338-46c8-bc40-b30ffd70cb8e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:13 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d757370-02af-44f1-bf40-33538a6dc450]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:50:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pENsPeRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26431623632636561', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431623632636561', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lazy-loading 'flavor' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] attach device xml: <disk type="block" device="disk">
Oct 25 17:50:14 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:14 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:50:14 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:50:14 user nova-compute[74739]:   <serial>64bdec79-5ed2-4455-9e7d-e57c262ed402</serial>
Oct 25 17:50:14 user nova-compute[74739]: </disk>
Oct 25 17:50:14 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] No VIF found with MAC fa:16:3e:cd:59:23, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ff01df2-f971-4d01-b605-6e41f0fe755b tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.741s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] volume_snapshot_create: create_info: {'snapshot_id': '10a73019-4613-4685-b75c-2a4752acd0b1', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74739) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] snap xml: <domainsnapshot>
Oct 25 17:50:15 user nova-compute[74739]:   <disks>
Oct 25 17:50:15 user nova-compute[74739]:     <disk name="/dev/sdd" snapshot="external" type="file">
Oct 25 17:50:15 user nova-compute[74739]:       <source file="/dev/new_file"/>
Oct 25 17:50:15 user nova-compute[74739]:     </disk>
Oct 25 17:50:15 user nova-compute[74739]:     <disk name="vda" snapshot="no"/>
Oct 25 17:50:15 user nova-compute[74739]:   </disks>
Oct 25 17:50:15 user nova-compute[74739]: </domainsnapshot>
Oct 25 17:50:15 user nova-compute[74739]:  {{(pid=74739) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 25 17:50:15 user nova-compute[74739]: DEBUG nova.objects.instance [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] Lazy-loading 'system_metadata' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     rv = execute(f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     six.reraise(c, e, tb)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     raise value
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     rv = meth(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     self._volume_snapshot_create(context, instance, guest,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     rv = execute(f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     six.reraise(c, e, tb)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     raise value
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     rv = meth(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] 
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c27ee91-f340-4118-86e4-cc8857ceaccb tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] volume_snapshot_delete: delete_info: {'volume_id': '64bdec79-5ed2-4455-9e7d-e57c262ed402'} {{(pid=74739) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [None req-3c27ee91-f340-4118-86e4-cc8857ceaccb tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb]     if delete_info['type'] != 'qcow2':
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] KeyError: 'type'
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 10a73019-4613-4685-b75c-2a4752acd0b1 could not be found.
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise value
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 10a73019-4613-4685-b75c-2a4752acd0b1 could not be found. (HTTP 404) (Request-ID: req-2dbc5c6a-79e9-462b-9aba-1679ca2eec98)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 10a73019-4613-4685-b75c-2a4752acd0b1 could not be found.
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server [None req-37701b07-5bc7-42e9-b5d2-ac117b275503 tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise value
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver [None req-3c27ee91-f340-4118-86e4-cc8857ceaccb tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d49faede-dd48-4857-9a5e-f9fbdd1efb9a)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 25 17:50:16 user nova-compute[74739]: ERROR nova.virt.libvirt.driver 
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server [None req-3c27ee91-f340-4118-86e4-cc8857ceaccb tempest-VolumesAssistedSnapshotsTest-1840324030 tempest-VolumesAssistedSnapshotsTest-1840324030-project] Exception during message handling: KeyError: 'type'
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 25 17:50:16 user nova-compute[74739]: ERROR oslo_messaging.rpc.server 
Oct 25 17:50:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:16 user nova-compute[74739]: INFO nova.compute.manager [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Detaching volume 64bdec79-5ed2-4455-9e7d-e57c262ed402
Oct 25 17:50:16 user nova-compute[74739]: INFO nova.virt.block_device [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Attempting to driver detach volume 64bdec79-5ed2-4455-9e7d-e57c262ed402 from mountpoint /dev/vdb
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Attempting to detach device vdb from instance c25ffdb2-6a06-4901-a454-02e6a379bffb from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 17:50:16 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:16 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:50:16 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:50:16 user nova-compute[74739]:   <serial>64bdec79-5ed2-4455-9e7d-e57c262ed402</serial>
Oct 25 17:50:16 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:50:16 user nova-compute[74739]: </disk>
Oct 25 17:50:16 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:50:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Successfully detached device vdb from instance c25ffdb2-6a06-4901-a454-02e6a379bffb from the persistent domain config.
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c25ffdb2-6a06-4901-a454-02e6a379bffb from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] detach device xml: <disk type="block" device="disk">
Oct 25 17:50:16 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:16 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:50:16 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:50:16 user nova-compute[74739]:   <serial>64bdec79-5ed2-4455-9e7d-e57c262ed402</serial>
Oct 25 17:50:16 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:50:16 user nova-compute[74739]: </disk>
Oct 25 17:50:16 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:50:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:50:20 user nova-compute[74739]: INFO nova.compute.claims [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Claim successful on node user
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:50:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.policy [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c1ddab8fb434e49b076d09fc47ab457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa01a7434304fa29b2944261e223a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:50:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Creating image(s)
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG nova.virt.images [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] 6dce144c-d2cf-4a7e-996a-497cd0fa6c74 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.part /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.part /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.converted" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Successfully created port: ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.965s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:50:21 user nova-compute[74739]: INFO nova.compute.claims [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Claim successful on node user
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1,backing_fmt=raw /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1,backing_fmt=raw /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk 1073741824" returned: 0 in 0.051s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "cf581a1dcecc0f7168458f35c7108bc54812b8d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:50:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json" returned: 0 in 0.226s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Successfully updated port: ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.policy [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964d6de8a5b7400ea3a45d666a499632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed00ba170e845c8ad57fe410d8388b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing instance network info cache due to event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:22 user nova-compute[74739]: INFO nova.virt.block_device [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Booting with blank volume at /dev/vda
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Cannot resize image /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Ensure instance console log exists: /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance network_info: |[{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start _get_guest_xml network_info=[{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:50:17Z,direct_url=<?>,disk_format='qcow2',id=6dce144c-d2cf-4a7e-996a-497cd0fa6c74,min_disk=0,min_ram=0,name='tempest-scenario-img--1591539766',owner='ffa01a7434304fa29b2944261e223a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:50:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '6dce144c-d2cf-4a7e-996a-497cd0fa6c74'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:50:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:50:17Z,direct_url=<?>,disk_format='qcow2',id=6dce144c-d2cf-4a7e-996a-497cd0fa6c74,min_disk=0,min_ram=0,name='tempest-scenario-img--1591539766',owner='ffa01a7434304fa29b2944261e223a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:50:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:50:21Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'pci_devices' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:50:22 user nova-compute[74739]:   <uuid>c5efeb2e-f9d5-42bc-a11f-397ab1f35823</uuid>
Oct 25 17:50:22 user nova-compute[74739]:   <name>instance-0000000c</name>
Oct 25 17:50:22 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:50:22 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:50:22 user nova-compute[74739]:   <metadata>
Oct 25 17:50:22 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:50:22 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:name>tempest-TestMinimumBasicScenario-server-337550697</nova:name>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:50:22</nova:creationTime>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:50:22 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:50:22 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:owner>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:user uuid="6c1ddab8fb434e49b076d09fc47ab457">tempest-TestMinimumBasicScenario-265773077-project-member</nova:user>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:project uuid="ffa01a7434304fa29b2944261e223a3a">tempest-TestMinimumBasicScenario-265773077</nova:project>
Oct 25 17:50:22 user nova-compute[74739]:       </nova:owner>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:root type="image" uuid="6dce144c-d2cf-4a7e-996a-497cd0fa6c74"/>
Oct 25 17:50:22 user nova-compute[74739]:       <nova:ports>
Oct 25 17:50:22 user nova-compute[74739]:         <nova:port uuid="ff881ee6-9485-4a9d-a60f-623bbf5169a1">
Oct 25 17:50:22 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 17:50:22 user nova-compute[74739]:         </nova:port>
Oct 25 17:50:22 user nova-compute[74739]:       </nova:ports>
Oct 25 17:50:22 user nova-compute[74739]:     </nova:instance>
Oct 25 17:50:22 user nova-compute[74739]:   </metadata>
Oct 25 17:50:22 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:50:22 user nova-compute[74739]:     <system>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="serial">c5efeb2e-f9d5-42bc-a11f-397ab1f35823</entry>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="uuid">c5efeb2e-f9d5-42bc-a11f-397ab1f35823</entry>
Oct 25 17:50:22 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:50:22 user nova-compute[74739]:     </system>
Oct 25 17:50:22 user nova-compute[74739]:   </sysinfo>
Oct 25 17:50:22 user nova-compute[74739]:   <os>
Oct 25 17:50:22 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:50:22 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:50:22 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:50:22 user nova-compute[74739]:   </os>
Oct 25 17:50:22 user nova-compute[74739]:   <features>
Oct 25 17:50:22 user nova-compute[74739]:     <acpi/>
Oct 25 17:50:22 user nova-compute[74739]:     <apic/>
Oct 25 17:50:22 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:50:22 user nova-compute[74739]:   </features>
Oct 25 17:50:22 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:50:22 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:50:22 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:50:22 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:50:22 user nova-compute[74739]:   </clock>
Oct 25 17:50:22 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:50:22 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:50:22 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:50:22 user nova-compute[74739]:   </cpu>
Oct 25 17:50:22 user nova-compute[74739]:   <devices>
Oct 25 17:50:22 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:50:22 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:50:22 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk"/>
Oct 25 17:50:22 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:50:22 user nova-compute[74739]:     </disk>
Oct 25 17:50:22 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:50:22 user nova-compute[74739]:       <mac address="fa:16:3e:73:f5:2d"/>
Oct 25 17:50:22 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:50:22 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:50:22 user nova-compute[74739]:       <target dev="tapff881ee6-94"/>
Oct 25 17:50:22 user nova-compute[74739]:     </interface>
Oct 25 17:50:22 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:50:22 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/console.log" append="off"/>
Oct 25 17:50:22 user nova-compute[74739]:     </serial>
Oct 25 17:50:22 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:50:22 user nova-compute[74739]:     <video>
Oct 25 17:50:22 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:50:22 user nova-compute[74739]:     </video>
Oct 25 17:50:22 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:50:22 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:50:22 user nova-compute[74739]:     </rng>
Oct 25 17:50:22 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:50:22 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:50:22 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:50:22 user nova-compute[74739]:     </memballoon>
Oct 25 17:50:22 user nova-compute[74739]:   </devices>
Oct 25 17:50:22 user nova-compute[74739]: </domain>
Oct 25 17:50:22 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:50:21Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG os_vif [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9ba7fe8-46ac-5059-84c7-a78e7afa50e9', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff881ee6-94, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff881ee6-94, col_values=(('qos', UUID('45ce4b79-a8db-4937-98ed-ae323f5ecc8e')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff881ee6-94, col_values=(('external_ids', {'iface-id': 'ff881ee6-9485-4a9d-a60f-623bbf5169a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f5:2d', 'vm-uuid': 'c5efeb2e-f9d5-42bc-a11f-397ab1f35823'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Successfully created port: 9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:50:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:50:22 user nova-compute[74739]: INFO os_vif [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94')
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No VIF found with MAC fa:16:3e:73:f5:2d, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:50:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 018d4427-32ef-4091-ae80-d30d33785609 is timed out.
Oct 25 17:50:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Successfully detached device sdc from instance 018d4427-32ef-4091-ae80-d30d33785609 from the live domain config.
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVsGWnAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:23 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[84075ceb-1bdf-4ead-8118-e28be6c38136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:50:23 user nova-compute[74739]: No targets found.
Oct 25 17:50:23 user nova-compute[74739]: iSNS:
Oct 25 17:50:23 user nova-compute[74739]: No targets found.
Oct 25 17:50:23 user nova-compute[74739]: STATIC:
Oct 25 17:50:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402
Oct 25 17:50:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:50:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:50:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1
Oct 25 17:50:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:50:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:50:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:50:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:50:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:50:23 user nova-compute[74739]: FIRMWARE:
Oct 25 17:50:23 user nova-compute[74739]: No targets found.
Oct 25 17:50:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:50:23 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:50:23 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8944a3b-b2d1-43c3-92b7-045ba8478540]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a3c95f-d4a5-4eef-b93e-4654eae6510a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:23 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:23 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 (non-flash)
Oct 25 17:50:23 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:23 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec175a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a59a8a6-ea6c-4437-9ddd-482c59a9e855]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b337435-0f0b-401f-9ef5-5c0b4963bcee]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1030054-26aa-4165-a0ba-bf34ac575568]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6bcd1-fd52-45c5-8e88-887e55e700ae]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9730607e-30d8-4343-9148-3f3c7408dcfa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated VIF entry in instance network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc1a94cf-0aa9-4d2d-bac8-e8fc0adc2faa req-a873a88b-81b8-4f84-841d-0dbccd235279 service nova] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8494688-fdb3-459a-976d-937ae1b5a060]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260]
Oct 25 17:50:23 user nova-compute[74739]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1, portal: 172.16.0.220,3260] successful.
Oct 25 17:50:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6ea651-3076-4023-9967-1a870374c5c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7624f69d-3275-4836-8c6f-c734a38caddf]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] <== disconnect_volume: return (303ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Successfully updated port: 9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-changed-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Refreshing instance network info cache due to event network-changed-9eacc6fc-2f3b-4670-93ec-9e7f49969255. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance network_info: |[{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Refreshing network info cache for port 9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG nova.objects.instance [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lazy-loading 'flavor' on Instance uuid 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG nova.network.neutron [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updated VIF entry in instance network info cache for port 9eacc6fc-2f3b-4670-93ec-9e7f49969255. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG nova.network.neutron [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-709f2239-8b4d-49ac-b02b-741d29a3af65 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-905539e9-3b91-4371-ac52-f19cc067fe05 req-6337be41-195e-4346-8919-1a9275b5eaac service nova] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.volume.cinder [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Update attachment failed for attachment 1627a358-6d11-48e2-9b3b-8bb7e8a6e4cb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Failed to connect to volume 9391917f-0988-4a94-b70d-624db34727b0 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Traceback (most recent call last):
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     new_cinfo = self.volume_api.attachment_update(
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     res = method(self, ctx, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     with excutils.save_and_reraise_exception():
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     self.force_reraise()
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     raise self.value
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     return method.func(obj, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     resp = self._update('/attachments/%s' % id, body)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     return self.request(url, method, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8]     raise exceptions.from_response(resp, body)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d)
Oct 25 17:50:24 user nova-compute[74739]: ERROR nova.compute.manager [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] 
Oct 25 17:50:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:24 user nova-compute[74739]: WARNING nova.compute.manager [req-fa683b97-3fbd-4f9b-8ae3-272561a4e864 req-379e13fe-30fc-434f-af4c-8cbc745c5d32 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state building and task_state spawning.
Oct 25 17:50:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.719s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server [None req-ed368f30-e480-4a4f-aacb-8bb637692fa0 tempest-TestVolumeSwap-1930383072 tempest-TestVolumeSwap-1930383072-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7902, in swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7900, in _do_locked_swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7944, in _do_swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7793, in _swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7769, in _swap_volume
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7742, in _init_volume_connection
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dc32c5b8-5ee7-4813-97de-79038f393a6d)
Oct 25 17:50:24 user nova-compute[74739]: ERROR oslo_messaging.rpc.server 
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:25 user nova-compute[74739]: INFO nova.compute.manager [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Terminating instance
Oct 25 17:50:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-unplugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] No waiting events found dispatching network-vif-unplugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-d93d3313-2fb7-4e5f-ac87-915f22bace63 req-c9f1642e-a83e-40d3-8e69-5c1e5fa873ea service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-unplugged-4f316f5c-99fe-4031-8f8b-f716b70b054e for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:50:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Instance destroyed successfully.
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lazy-loading 'resources' on Instance uuid 018d4427-32ef-4091-ae80-d30d33785609 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-535758845',display_name='tempest-AttachSCSIVolumeTestJSON-server-535758845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-535758845',id=6,image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKuHpdcNIfHDvAyBu8nMagY/tT9r1yNVrG993Wc+E1iXolNQCMHZCcB5kagFGFrO6fMCFMxfLGXSOohzZYA4gRTjnoInZF5qCjEjQt5ZvP+S18lO8rRocJtU8Ygmtv7yA==',key_name='tempest-keypair-17758535',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bb4703f276148b49fde12b8e20375d2',ramdisk_id='',reservation_id='r-33ew9ew9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0dbfb896-04fa-4e5b-bf98-192ca7d22fde',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1453914393',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1453914393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:47:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a06fd9981b3417faea6ac4ad96f8cb0',uuid=018d4427-32ef-4091-ae80-d30d33785609,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converting VIF {"id": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "address": "fa:16:3e:9b:19:7a", "network": {"id": "2f10bd5d-34af-4557-a05d-9012a21c8e52", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-55157359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bb4703f276148b49fde12b8e20375d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f316f5c-99", "ovs_interfaceid": "4f316f5c-99fe-4031-8f8b-f716b70b054e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG os_vif [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f316f5c-99, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c989d672-1fd7-44c6-9a29-aa395cb0ca44) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:50:26 user nova-compute[74739]: INFO os_vif [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:19:7a,bridge_name='br-int',has_traffic_filtering=True,id=4f316f5c-99fe-4031-8f8b-f716b70b054e,network=Network(2f10bd5d-34af-4557-a05d-9012a21c8e52),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f316f5c-99')
Oct 25 17:50:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Deleting instance files /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609_del
Oct 25 17:50:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Deletion of /opt/stack/data/nova/instances/018d4427-32ef-4091-ae80-d30d33785609_del complete
Oct 25 17:50:26 user nova-compute[74739]: INFO nova.compute.manager [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 25 17:50:26 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:26 user nova-compute[74739]: WARNING nova.compute.manager [req-c1ac8494-3954-418b-806a-784fad5989d1 req-a4612edd-7b11-463b-aaac-e6d2414d054e service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state building and task_state spawning.
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:50:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance spawned successfully.
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:27 user nova-compute[74739]: INFO nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:50:27 user nova-compute[74739]: INFO nova.compute.manager [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Took 7.08 seconds to build instance.
Oct 25 17:50:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f1c3a1a1-5106-4ae9-8278-d6e08467b4cc tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.188s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-36859e68-3665-4953-ad01-d1d53ee57cf8 req-4f4aa04b-5718-4f54-a1b5-cebe322d2fcc service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-deleted-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:27 user nova-compute[74739]: INFO nova.compute.manager [req-36859e68-3665-4953-ad01-d1d53ee57cf8 req-4f4aa04b-5718-4f54-a1b5-cebe322d2fcc service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Neutron deleted interface 4f316f5c-99fe-4031-8f8b-f716b70b054e; detaching it from the instance and deleting it from the info cache
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.network.neutron [req-36859e68-3665-4953-ad01-d1d53ee57cf8 req-4f4aa04b-5718-4f54-a1b5-cebe322d2fcc service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:27 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Took 0.86 seconds to deallocate network for instance.
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-36859e68-3665-4953-ad01-d1d53ee57cf8 req-4f4aa04b-5718-4f54-a1b5-cebe322d2fcc service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Detach interface failed, port_id=4f316f5c-99fe-4031-8f8b-f716b70b054e, reason: Instance 018d4427-32ef-4091-ae80-d30d33785609 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:50:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:27 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Deleted allocations for instance 018d4427-32ef-4091-ae80-d30d33785609
Oct 25 17:50:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f48560ec-6cc5-413f-8fca-91a1075a2a96 tempest-AttachSCSIVolumeTestJSON-1453914393 tempest-AttachSCSIVolumeTestJSON-1453914393-project-member] Lock "018d4427-32ef-4091-ae80-d30d33785609" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] Acquiring lock "018d4427-32ef-4091-ae80-d30d33785609-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] Lock "018d4427-32ef-4091-ae80-d30d33785609-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] No waiting events found dispatching network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:28 user nova-compute[74739]: WARNING nova.compute.manager [req-b38bec83-4406-4f2f-b5bd-0eb0f424933d req-e71ce5fb-bae0-4713-b7c3-61aa7e2dcbd0 service nova] [instance: 018d4427-32ef-4091-ae80-d30d33785609] Received unexpected event network-vif-plugged-4f316f5c-99fe-4031-8f8b-f716b70b054e for instance with vm_state deleted and task_state None.
Oct 25 17:50:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.utils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013729a-6438-4a54-8e77-e70ed7c7b57c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb011bd-809f-461b-b70f-4c6de9c838b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32eb352-4540-4191-9026-f4d7482facdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2002c08-8cee-4bc4-87cd-a2942cb98871]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:33 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:50:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa161d0-07ac-4e80-919f-9f092a091242]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG os_brick.utils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:33 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating existing volume attachment record: d6570e6c-d546-4e63-a74f-792ec8a9ae31 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:50:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c25ffdb2-6a06-4901-a454-02e6a379bffb is timed out.
Oct 25 17:50:36 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Successfully detached device vdb from instance c25ffdb2-6a06-4901-a454-02e6a379bffb from the live domain config.
Oct 25 17:50:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:50:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pENsPeRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:36 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da107b14-9156-4409-8f8f-05c841cc1612]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:50:37 user nova-compute[74739]: No targets found.
Oct 25 17:50:37 user nova-compute[74739]: iSNS:
Oct 25 17:50:37 user nova-compute[74739]: No targets found.
Oct 25 17:50:37 user nova-compute[74739]: STATIC:
Oct 25 17:50:37 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402
Oct 25 17:50:37 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:50:37 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:50:37 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:50:37 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:50:37 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:50:37 user nova-compute[74739]: FIRMWARE:
Oct 25 17:50:37 user nova-compute[74739]: No targets found.
Oct 25 17:50:37 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:50:37 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:50:37 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea84965b-11cb-4570-846a-902d4d42d2d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a5b305-57b0-4580-a2c7-228f35bc23cd]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:37 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:37 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:37 user nova-compute[74739]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 (non-flash)
Oct 25 17:50:37 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec754820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a8ba1-8cf8-455b-987d-97f8c93d2136]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2b333d-f3b1-40d2-8e0c-5519cc9dd3ab]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbf408-7d78-49cf-904b-47f701017e8e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c13be7-dcd2-421f-9f30-d020fa5adcce]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[423918f1-91fe-47ff-af31-d1fa59c2a836]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03813fd-6083-49a5-a346-ea80053c6f08]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260]
Oct 25 17:50:37 user nova-compute[74739]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402, portal: 172.16.0.220,3260] successful.
Oct 25 17:50:37 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64bdec79-5ed2-4455-9e7d-e57c262ed402 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b9cefd-7c95-48ee-8e49-3cde52c05162]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] <== disconnect_volume: return (344ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:50:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:38 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lazy-loading 'flavor' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ac3c125-a2c1-4272-a8fd-632e4d2af2f2 tempest-VolumesAssistedSnapshotsTest-1030420855 tempest-VolumesAssistedSnapshotsTest-1030420855-project-admin] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.946s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received event network-changed-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Refreshing instance network info cache due to event network-changed-fab33d97-c0af-43d1-bea2-5b862371e93e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] Acquiring lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] Acquired lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Refreshing network info cache for port fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Ignoring supplied device name: /dev/vdb
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:45 user nova-compute[74739]: INFO nova.compute.manager [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Attaching volume 5f74b52c-0eb8-4301-99be-83dd9daa2074 to /dev/vdb
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updated VIF entry in instance network info cache for port fab33d97-c0af-43d1-bea2-5b862371e93e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating instance_info_cache with network_info: [{"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.utils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe44899f-5c95-4d9f-a1b6-6943a46e80d0 req-f0a9f62f-e1e1-4564-8678-e1877a9c9006 service nova] Releasing lock "refresh_cache-bdcd3887-b9d6-42f3-b758-1410e22af542" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8d9b32-a064-49cf-b342-53061ac65a41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fcf679-c772-41e3-bb47-49b9a005e7ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[190b2173-fa67-4395-bd15-9f356fd77cc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd9817c-d5d5-4bc7-a48e-9a47b96335c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:50:45 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:50:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b0321a-d038-4bd5-adb1-ddf52dba31b4]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG os_brick.utils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:45 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating existing volume attachment record: 3ef89e2c-6041-4ac5-a9ea-f48195e77fd8 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:50:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:50:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Creating image(s)
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Ensure instance console log exists: /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start _get_guest_xml network_info=[{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd6570e6c-d546-4e63-a74f-792ec8a9ae31', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ebb8df7-813e-4118-9689-f56934edf958', 'attached_at': '', 'detached_at': '', 'volume_id': '72ee0394-046b-4829-8988-a682bfacb118', 'serial': '72ee0394-046b-4829-8988-a682bfacb118'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:50:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:50:52 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:52 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:50:52 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:50:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c727167-bf92-42ed-9369-173d6e2a10d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:50:52 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71927f-6a18-4d59-a295-8fd3e4a9cce2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118] added
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a961db4-ecda-418e-bea3-9a2d38bd28b4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[df280804-d686-481b-9766-00030098dc6c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srJwcgim {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srJwcgim" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[edadb5ca-1b92-478c-a540-59fe628c5856]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srJwcgim'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[22307a9d-3e3c-41e0-8dbb-61ff199ae2d6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a2327-5e11-409f-91f6-27be9e3d0d33]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ed982-21cc-4c41-885a-85bf5f5bfb1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260]
Oct 25 17:50:52 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260] successful.
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a138369-74a6-4e59-b97e-7eb19be1a44d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ca07e-87cb-4970-ab35-5bd3757454fb]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:52 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:50:52 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:50:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bca48b5-633e-4eb7-9369-ccafcfacae9f]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:50:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23637336363633837', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637336363633837', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1931905537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1931905537',id=13,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-fo89rnny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:50:22Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=3ebb8df7-813e-4118-9689-f56934edf958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:50:53 user nova-compute[74739]:   <uuid>3ebb8df7-813e-4118-9689-f56934edf958</uuid>
Oct 25 17:50:53 user nova-compute[74739]:   <name>instance-0000000d</name>
Oct 25 17:50:53 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:50:53 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:50:53 user nova-compute[74739]:   <metadata>
Oct 25 17:50:53 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:50:53 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1931905537</nova:name>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:50:52</nova:creationTime>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:50:53 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:50:53 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:owner>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 17:50:53 user nova-compute[74739]:       </nova:owner>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:50:53 user nova-compute[74739]:       <nova:ports>
Oct 25 17:50:53 user nova-compute[74739]:         <nova:port uuid="9eacc6fc-2f3b-4670-93ec-9e7f49969255">
Oct 25 17:50:53 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:50:53 user nova-compute[74739]:         </nova:port>
Oct 25 17:50:53 user nova-compute[74739]:       </nova:ports>
Oct 25 17:50:53 user nova-compute[74739]:     </nova:instance>
Oct 25 17:50:53 user nova-compute[74739]:   </metadata>
Oct 25 17:50:53 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:50:53 user nova-compute[74739]:     <system>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="serial">3ebb8df7-813e-4118-9689-f56934edf958</entry>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="uuid">3ebb8df7-813e-4118-9689-f56934edf958</entry>
Oct 25 17:50:53 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:50:53 user nova-compute[74739]:     </system>
Oct 25 17:50:53 user nova-compute[74739]:   </sysinfo>
Oct 25 17:50:53 user nova-compute[74739]:   <os>
Oct 25 17:50:53 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:50:53 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:50:53 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:50:53 user nova-compute[74739]:   </os>
Oct 25 17:50:53 user nova-compute[74739]:   <features>
Oct 25 17:50:53 user nova-compute[74739]:     <acpi/>
Oct 25 17:50:53 user nova-compute[74739]:     <apic/>
Oct 25 17:50:53 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:50:53 user nova-compute[74739]:   </features>
Oct 25 17:50:53 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:50:53 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:50:53 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:50:53 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:50:53 user nova-compute[74739]:   </clock>
Oct 25 17:50:53 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:50:53 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:50:53 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:50:53 user nova-compute[74739]:   </cpu>
Oct 25 17:50:53 user nova-compute[74739]:   <devices>
Oct 25 17:50:53 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:50:53 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:50:53 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 17:50:53 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:50:53 user nova-compute[74739]:       <serial>72ee0394-046b-4829-8988-a682bfacb118</serial>
Oct 25 17:50:53 user nova-compute[74739]:     </disk>
Oct 25 17:50:53 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:50:53 user nova-compute[74739]:       <mac address="fa:16:3e:44:d9:50"/>
Oct 25 17:50:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:50:53 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:50:53 user nova-compute[74739]:       <target dev="tap9eacc6fc-2f"/>
Oct 25 17:50:53 user nova-compute[74739]:     </interface>
Oct 25 17:50:53 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:50:53 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/console.log" append="off"/>
Oct 25 17:50:53 user nova-compute[74739]:     </serial>
Oct 25 17:50:53 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:50:53 user nova-compute[74739]:     <video>
Oct 25 17:50:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:50:53 user nova-compute[74739]:     </video>
Oct 25 17:50:53 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:50:53 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:50:53 user nova-compute[74739]:     </rng>
Oct 25 17:50:53 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:50:53 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:50:53 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:50:53 user nova-compute[74739]:     </memballoon>
Oct 25 17:50:53 user nova-compute[74739]:   </devices>
Oct 25 17:50:53 user nova-compute[74739]: </domain>
Oct 25 17:50:53 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1931905537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1931905537',id=13,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-fo89rnny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:50:22Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=3ebb8df7-813e-4118-9689-f56934edf958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG os_vif [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3c9147f-f441-51ff-8beb-0f8289f0ab50', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eacc6fc-2f, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eacc6fc-2f, col_values=(('qos', UUID('b1ecdc4c-19c8-4599-b8f4-b3d4c4b5ca74')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eacc6fc-2f, col_values=(('external_ids', {'iface-id': '9eacc6fc-2f3b-4670-93ec-9e7f49969255', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:d9:50', 'vm-uuid': '3ebb8df7-813e-4118-9689-f56934edf958'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:53 user nova-compute[74739]: INFO os_vif [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f')
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:50:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:44:d9:50, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:50:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:55 user nova-compute[74739]: WARNING nova.compute.manager [req-fee92ec0-d0a3-449a-a37c-87a450ba99e9 req-e347d35a-f8d3-4bf7-89f8-f2351824e4eb service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state building and task_state spawning.
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:50:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance spawned successfully.
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:50:57 user nova-compute[74739]: WARNING nova.compute.manager [req-81fd2d90-3b10-464a-8f5a-1e39fb57fed6 req-3e51b8a5-1511-4fc2-b3e3-59da8a8d233c service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state building and task_state spawning.
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:50:57 user nova-compute[74739]: INFO nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 25 17:50:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:50:57 user nova-compute[74739]: INFO nova.compute.manager [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Took 36.14 seconds to build instance.
Oct 25 17:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a4cccee-32d6-4dbb-bf16-0a6218ce80b1 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.266s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:50:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:50:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:51:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:51:02 user nova-compute[74739]: INFO nova.compute.claims [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Claim successful on node user
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:51:02 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.policy [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db9e105e32fb4d5782cc5af8eaa4c06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d5c35e2c04cb18fa027da2ff93c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:51:02 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Creating image(s)
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "/opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "/opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "/opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk 1073741824" returned: 0 in 0.062s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Successfully created port: 532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Cannot resize image /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Ensure instance console log exists: /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Successfully updated port: 532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquired lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-changed-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Refreshing instance network info cache due to event network-changed-532b1fc6-305d-4f99-9bb1-d70f334b5afb. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] Acquiring lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:51:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updating instance_info_cache with network_info: [{"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Releasing lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Instance network_info: |[{"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] Acquired lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Refreshing network info cache for port 532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Start _get_guest_xml network_info=[{"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:51:04 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:04 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424304868',display_name='tempest-ServersNegativeTestJSON-server-1424304868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424304868',id=14,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-n0w1vfd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:51:03Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=08290f01-eee3-48ee-b4a0-1d976346f139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lazy-loading 'pci_devices' on Instance uuid 08290f01-eee3-48ee-b4a0-1d976346f139 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:51:04 user nova-compute[74739]:   <uuid>08290f01-eee3-48ee-b4a0-1d976346f139</uuid>
Oct 25 17:51:04 user nova-compute[74739]:   <name>instance-0000000e</name>
Oct 25 17:51:04 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:51:04 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:51:04 user nova-compute[74739]:   <metadata>
Oct 25 17:51:04 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:51:04 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:name>tempest-ServersNegativeTestJSON-server-1424304868</nova:name>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:51:04</nova:creationTime>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:51:04 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:51:04 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:owner>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:user uuid="db9e105e32fb4d5782cc5af8eaa4c06b">tempest-ServersNegativeTestJSON-334148990-project-member</nova:user>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:project uuid="e29d5c35e2c04cb18fa027da2ff93c62">tempest-ServersNegativeTestJSON-334148990</nova:project>
Oct 25 17:51:04 user nova-compute[74739]:       </nova:owner>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:51:04 user nova-compute[74739]:       <nova:ports>
Oct 25 17:51:04 user nova-compute[74739]:         <nova:port uuid="532b1fc6-305d-4f99-9bb1-d70f334b5afb">
Oct 25 17:51:04 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 17:51:04 user nova-compute[74739]:         </nova:port>
Oct 25 17:51:04 user nova-compute[74739]:       </nova:ports>
Oct 25 17:51:04 user nova-compute[74739]:     </nova:instance>
Oct 25 17:51:04 user nova-compute[74739]:   </metadata>
Oct 25 17:51:04 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:51:04 user nova-compute[74739]:     <system>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="serial">08290f01-eee3-48ee-b4a0-1d976346f139</entry>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="uuid">08290f01-eee3-48ee-b4a0-1d976346f139</entry>
Oct 25 17:51:04 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:51:04 user nova-compute[74739]:     </system>
Oct 25 17:51:04 user nova-compute[74739]:   </sysinfo>
Oct 25 17:51:04 user nova-compute[74739]:   <os>
Oct 25 17:51:04 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:51:04 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:51:04 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:51:04 user nova-compute[74739]:   </os>
Oct 25 17:51:04 user nova-compute[74739]:   <features>
Oct 25 17:51:04 user nova-compute[74739]:     <acpi/>
Oct 25 17:51:04 user nova-compute[74739]:     <apic/>
Oct 25 17:51:04 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:51:04 user nova-compute[74739]:   </features>
Oct 25 17:51:04 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:51:04 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:51:04 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:51:04 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:51:04 user nova-compute[74739]:   </clock>
Oct 25 17:51:04 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:51:04 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:51:04 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:51:04 user nova-compute[74739]:   </cpu>
Oct 25 17:51:04 user nova-compute[74739]:   <devices>
Oct 25 17:51:04 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:51:04 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:51:04 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk"/>
Oct 25 17:51:04 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:51:04 user nova-compute[74739]:     </disk>
Oct 25 17:51:04 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:51:04 user nova-compute[74739]:       <mac address="fa:16:3e:44:99:85"/>
Oct 25 17:51:04 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:51:04 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:51:04 user nova-compute[74739]:       <target dev="tap532b1fc6-30"/>
Oct 25 17:51:04 user nova-compute[74739]:     </interface>
Oct 25 17:51:04 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:51:04 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/console.log" append="off"/>
Oct 25 17:51:04 user nova-compute[74739]:     </serial>
Oct 25 17:51:04 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:51:04 user nova-compute[74739]:     <video>
Oct 25 17:51:04 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:51:04 user nova-compute[74739]:     </video>
Oct 25 17:51:04 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:51:04 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:51:04 user nova-compute[74739]:     </rng>
Oct 25 17:51:04 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:51:04 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:51:04 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:51:04 user nova-compute[74739]:     </memballoon>
Oct 25 17:51:04 user nova-compute[74739]:   </devices>
Oct 25 17:51:04 user nova-compute[74739]: </domain>
Oct 25 17:51:04 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424304868',display_name='tempest-ServersNegativeTestJSON-server-1424304868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424304868',id=14,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-n0w1vfd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:51:03Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=08290f01-eee3-48ee-b4a0-1d976346f139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_vif [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a93f52-0fe0-5f60-9106-6fa54b049728', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap532b1fc6-30, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap532b1fc6-30, col_values=(('qos', UUID('a8563370-5b1d-46fd-8a3d-230b8221cfb6')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap532b1fc6-30, col_values=(('external_ids', {'iface-id': '532b1fc6-305d-4f99-9bb1-d70f334b5afb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:99:85', 'vm-uuid': '08290f01-eee3-48ee-b4a0-1d976346f139'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: INFO os_vif [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30')
Oct 25 17:51:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] No VIF found with MAC fa:16:3e:44:99:85, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updated VIF entry in instance network info cache for port 532b1fc6-305d-4f99-9bb1-d70f334b5afb. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updating instance_info_cache with network_info: [{"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-07b46588-aa38-4967-891c-3b0d1fbc5cdc req-44844f21-aefc-4b2e-8f7a-9e8091a8093b service nova] Releasing lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSafcgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:04 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b6b0f-7720-4246-a7bf-a0eb81a43bd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:51:04 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ea24b-ed42-40b7-bd1f-1e7d0b92a4d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074] added
Oct 25 17:51:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df2bf49-f2ee-4d98-b325-98f6d14f378a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0879f5-6fc6-4b2e-934d-e1a68b4f3c43]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSafcgCW {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSafcgCW" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0200e602-c37f-4377-82ac-f807225387a1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSafcgCW'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bafeacc-8b68-4600-8ed5-1816d93aadc0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0c19a3-962a-4474-9c43-9af53de5c7f6]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddaf6f5-99db-4ac5-b873-db77756837e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260]
Oct 25 17:51:05 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260] successful.
Oct 25 17:51:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d086a6-d59f-44dd-a320-a54fef225f16]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d27a6-219b-4429-af23-03e5ab5488ba]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] HCTL ('35', '-', '-', 0) found on session 7 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d25d2-1fcf-4678-beb4-d6d246d8cb89]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] No waiting events found dispatching network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:06 user nova-compute[74739]: WARNING nova.compute.manager [req-2fdd88e8-9433-48d6-8636-5da6b844ab39 req-858e97b9-6d34-431b-b93d-ecae193b05a6 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received unexpected event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb for instance with vm_state building and task_state spawning.
Oct 25 17:51:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching for a device in session 7 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSafcgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23765333230353239', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333230353239', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:51:06 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:51:06 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:51:06 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:51:06 user nova-compute[74739]:   <serial>5f74b52c-0eb8-4301-99be-83dd9daa2074</serial>
Oct 25 17:51:06 user nova-compute[74739]: </disk>
Oct 25 17:51:06 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No VIF found with MAC fa:16:3e:ad:71:5d, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9217e9c8-8bb9-46cc-9817-08c967d0591b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.328s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] No waiting events found dispatching network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:08 user nova-compute[74739]: WARNING nova.compute.manager [req-5b3c4990-4a4b-4dfb-811a-f75cedcda660 req-906c3ca8-f43e-4858-be03-dc382d75cb80 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received unexpected event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb for instance with vm_state building and task_state spawning.
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:51:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Instance spawned successfully.
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:08 user nova-compute[74739]: INFO nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 25 17:51:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:51:08 user nova-compute[74739]: INFO nova.compute.manager [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Took 6.88 seconds to build instance.
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b571ef3-368b-4c6f-aaaa-45ed495b00fc tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.029s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:51:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7908MB free_disk=25.304943084716797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c25ffdb2-6a06-4901-a454-02e6a379bffb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bdcd3887-b9d6-42f3-b758-1410e22af542 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:11 user nova-compute[74739]: DEBUG nova.objects.instance [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'flavor' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:12 user nova-compute[74739]: INFO nova.compute.manager [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attaching volume 1be5522d-af74-404d-bf6b-60f854ada82b to /dev/vdb
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[19432231-be52-429a-8923-e6eb601d2b35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57fa14c-277b-4842-a00d-c842191fa2c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d75bad-64dd-4733-83fc-3a1f4075347d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012f1e6-c1ec-498b-9bd5-d0dfaaa23d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:12 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:51:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ea486d-a7e8-4601-813f-e8b7eb0cf629]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:12 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating existing volume attachment record: 177df0d3-603a-41ac-a628-e4b356884a56 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:51:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:16 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'flavor' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:17 user nova-compute[74739]: INFO nova.compute.manager [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Attaching volume ab2f5ae7-580d-4288-880e-8b8102af5b8a to /dev/vdb
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e47800b-0cd9-48f5-8940-eea4b16552a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a3b46e-90a6-4504-ad92-86283f9cde3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cde5a9-11ce-4bc5-ba40-9c5feebf4361]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83fecd7-b3f7-4b61-ad5b-51873c67c661]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:17 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0279a56-9a76-4b33-a8f6-2f045d3bb6cc]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating existing volume attachment record: 29fab47e-4671-43a0-8d9e-539cd74560e2 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:17 user nova-compute[74739]: INFO nova.compute.manager [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Terminating instance
Oct 25 17:51:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:18 user nova-compute[74739]: INFO nova.compute.manager [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Unshelving
Oct 25 17:51:18 user nova-compute[74739]: INFO nova.virt.block_device [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Booting with volume 69cb53dc-79b3-4e10-ae03-93c970cc8770 at /dev/vdc
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-unplugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] No waiting events found dispatching network-vif-unplugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-b3b93c55-dd69-47a1-ba4d-3f3fa34b9b51 req-59862a4f-caaf-4b3f-aadc-69642d1b05ec service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-unplugged-7e87b1fd-fdce-4810-b4c5-2690d673240b for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.utils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a1f8c-ca0a-4a69-bf50-268ddad9310c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:18 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Instance destroyed successfully.
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lazy-loading 'resources' on Instance uuid c25ffdb2-6a06-4901-a454-02e6a379bffb {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee720b87-40bc-4829-a1a7-9b4d38a4858d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1846438781',display_name='tempest-VolumesAssistedSnapshotsTest-server-1846438781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1846438781',id=9,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4nP7TSkg4+HElGj7a2cl5KZjzjTcMo8Q6OfqbyN/F2Pj56efKw/STZdF/o5yWHQ12rrMYVt1dMxTykyAz2SXGDuMlHJ/InGZ0o43VOtN14Jw9C/ol02haQFkNiOHbpSg==',key_name='tempest-keypair-575333134',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:48:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ca00e5558cc4ab9bd1fb6d3d3eb0158',ramdisk_id='',reservation_id='r-q00g03vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-158223859',owner_user_name='tempest-VolumesAssistedSnapshotsTest-158223859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:48:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f303bb86710a455d823cf353b24da137',uuid=c25ffdb2-6a06-4901-a454-02e6a379bffb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converting VIF {"id": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "address": "fa:16:3e:cd:59:23", "network": {"id": "a9c48534-2739-4d3c-b5ce-f93b17a63f2c", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-889479145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ca00e5558cc4ab9bd1fb6d3d3eb0158", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e87b1fd-fd", "ovs_interfaceid": "7e87b1fd-fdce-4810-b4c5-2690d673240b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_vif [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232446e-2e28-4774-ab95-5eb34ca6fddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e87b1fd-fd, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379b9d2-31a9-4537-b90a-7c01039cde90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a39cb99-b5ea-4cc0-91c0-169e3160913b) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:51:18 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:51:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cfd643-0b9a-4493-a8af-2a2a8897ff7d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG os_brick.utils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:18 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating existing volume attachment record: f17f12a1-c023-4619-aee0-2d3b8c220611 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:51:18 user nova-compute[74739]: INFO os_vif [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:59:23,bridge_name='br-int',has_traffic_filtering=True,id=7e87b1fd-fdce-4810-b4c5-2690d673240b,network=Network(a9c48534-2739-4d3c-b5ce-f93b17a63f2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e87b1fd-fd')
Oct 25 17:51:18 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Deleting instance files /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb_del
Oct 25 17:51:18 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Deletion of /opt/stack/data/nova/instances/c25ffdb2-6a06-4901-a454-02e6a379bffb_del complete
Oct 25 17:51:19 user nova-compute[74739]: INFO nova.compute.manager [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 25 17:51:19 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:51:19 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:51:19 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:51:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:51:20 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Took 1.06 seconds to deallocate network for instance.
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-046a6786-8c29-45fd-8c0b-dc10a3a2083e req-d109fe2d-cfcf-4e1f-a152-33f4f6dc5f22 service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-deleted-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] Acquiring lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] No waiting events found dispatching network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:20 user nova-compute[74739]: WARNING nova.compute.manager [req-8a456dd9-6819-4bb0-9e62-c885af7d63d3 req-04ee9b41-34a9-45f2-981f-0391d89b5691 service nova] [instance: c25ffdb2-6a06-4901-a454-02e6a379bffb] Received unexpected event network-vif-plugged-7e87b1fd-fdce-4810-b4c5-2690d673240b for instance with vm_state deleted and task_state None.
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:20 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Deleted allocations for instance c25ffdb2-6a06-4901-a454-02e6a379bffb
Oct 25 17:51:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-89140951-0c8b-4733-8136-1a970bb431d1 tempest-VolumesAssistedSnapshotsTest-158223859 tempest-VolumesAssistedSnapshotsTest-158223859-project-member] Lock "c25ffdb2-6a06-4901-a454-02e6a379bffb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:32 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da06068-cbd2-4b78-b2cb-932b1a6728b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:51:32 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[958ef932-f832-40f5-8f9c-6e4d0c3439f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b] added
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0b75d7-b7f4-4b9f-bc63-f76899dc9532]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e95bb-020e-4845-99c1-933b6d44f954]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvhSOefk {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvhSOefk" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2815a6-d4ea-427d-b6e5-a353e421489f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvhSOefk'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd355c-6f30-4d2b-9cc0-c74305d5926f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb626a-6329-42bf-aef3-c2431a97d2c0]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[29336dd3-18cf-4985-b742-591858c40fac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260]
Oct 25 17:51:32 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260] successful.
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0853a-4a8c-4ca2-9d81-3af521bb1fc9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e93027-fd36-480e-af6f-7437b9a82c24]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:32 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:51:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[460fffee-2645-4800-83ae-6dfef1081229]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:51:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23233323839313838', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233323839313838', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'flavor' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:51:33 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:51:33 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:51:33 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:51:33 user nova-compute[74739]:   <serial>1be5522d-af74-404d-bf6b-60f854ada82b</serial>
Oct 25 17:51:33 user nova-compute[74739]: </disk>
Oct 25 17:51:33 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:51:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No VIF found with MAC fa:16:3e:0a:58:cf, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:51:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3b8a2ed0-9a35-4219-a01c-ff7059ecfab2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.287s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:35 user nova-compute[74739]: INFO nova.compute.manager [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Rescuing
Oct 25 17:51:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:51:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:51:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:36 user nova-compute[74739]: WARNING nova.compute.manager [req-3deb2818-3c2f-4c47-8a42-eeeab17d782a req-38dc4aeb-c2c4-4edf-9cd9-7d7b0b55916d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state rescuing.
Oct 25 17:51:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance destroyed successfully.
Oct 25 17:51:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attempting a stable device rescue
Oct 25 17:51:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 17:51:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Creating image(s)
Oct 25 17:51:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG nova.virt.images [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] 6fc67823-5260-473e-8e4f-f11ee4718452 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.part /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:38 user nova-compute[74739]: WARNING nova.compute.manager [req-a2e9c4f0-8274-4a6d-8d0e-d6b3c79d5216 req-00db6778-731c-4a3b-b6f7-fb5b45570d8d service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state rescuing.
Oct 25 17:51:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.part /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.converted" returned: 0 in 0.375s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.885s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f --force-share --output=json" returned: 0 in 0.218s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f,backing_fmt=raw /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f,backing_fmt=raw /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue" returned: 0 in 0.051s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "11c7da13b703f40f719f9e2ec402d264ffbb8c2f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'migration_context' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Object Instance<cb37a637-7bf4-449d-b291-6986eea005e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start _get_guest_xml network_info=[{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "vif_mac": "fa:16:3e:0a:58:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6fc67823-5260-473e-8e4f-f11ee4718452', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '177df0d3-603a-41ac-a628-e4b356884a56', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'cb37a637-7bf4-449d-b291-6986eea005e9', 'attached_at': '', 'detached_at': '', 'volume_id': '1be5522d-af74-404d-bf6b-60f854ada82b', 'serial': '1be5522d-af74-404d-bf6b-60f854ada82b'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'resources' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Object Instance<cb37a637-7bf4-449d-b291-6986eea005e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'numa_topology' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Object Instance<cb37a637-7bf4-449d-b291-6986eea005e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:51:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.objects.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Object Instance<cb37a637-7bf4-449d-b291-6986eea005e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:51:39 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:39 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:51:39 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1441ec-1d01-4ca3-afe6-0f0fa9719f62]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IvhSOefk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 17:51:39 user nova-compute[74739]: node.name = iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:51:39 user nova-compute[74739]: node.tpgt = -1
Oct 25 17:51:39 user nova-compute[74739]: node.startup = automatic
Oct 25 17:51:39 user nova-compute[74739]: node.leading_login = No
Oct 25 17:51:39 user nova-compute[74739]: iface.iscsi_ifacename = default
Oct 25 17:51:39 user nova-compute[74739]: iface.net_ifacename = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.ipaddress = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.prefix_len = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.hwaddress = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.transport_name = tcp
Oct 25 17:51:39 user nova-compute[74739]: iface.initiatorname = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.vlan_id = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.vlan_priority = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.vlan_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.iface_num = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.mtu = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.port = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.bootproto = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.subnet_mask = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.gateway = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_alt_client_id = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_dns = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_learn_iqn = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_vendor_id_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_vendor_id = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.dhcp_slp_da = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.fragmentation = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.gratuitous_arp = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.incoming_forwarding = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.tos_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.tos = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.ttl = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.delayed_ack = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.tcp_nagle = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.tcp_wsf_state = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.tcp_wsf = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.tcp_timer_scale = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.tcp_timestamp = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.redirect = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.def_task_mgmt_timeout = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.header_digest = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.data_digest = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.immediate_data = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.initial_r2t = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.data_seq_inorder = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.data_pdu_inorder = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.erl = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.max_receive_data_len = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.first_burst_len = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.max_outstanding_r2t = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.max_burst_len = 0
Oct 25 17:51:39 user nova-compute[74739]: iface.chap_auth = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.bidi_chap = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.strict_login_compliance = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.discovery_auth = <empty>
Oct 25 17:51:39 user nova-compute[74739]: iface.discovery_logout = <empty>
Oct 25 17:51:39 user nova-compute[74739]: node.discovery_address = <empty>
Oct 25 17:51:39 user nova-compute[74739]: node.discovery_port = 0
Oct 25 17:51:39 user nova-compute[74739]: node.discovery_type = static
Oct 25 17:51:39 user nova-compute[74739]: node.session.initial_cmdsn = 0
Oct 25 17:51:39 user nova-compute[74739]: node.session.initial_login_retry_max = 8
Oct 25 17:51:39 user nova-compute[74739]: node.session.xmit_thread_priority = -20
Oct 25 17:51:39 user nova-compute[74739]: node.session.cmds_max = 128
Oct 25 17:51:39 user nova-compute[74739]: node.session.queue_depth = 32
Oct 25 17:51:39 user nova-compute[74739]: node.session.nr_sessions = 1
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.authmethod = CHAP
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.username = IvhSOefk
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.password = ***
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.username_in = <empty>
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.password_in = <empty>
Oct 25 17:51:39 user nova-compute[74739]: node.session.auth.chap_algs = MD5
Oct 25 17:51:39 user nova-compute[74739]: node.session.timeo.replacement_timeout = 120
Oct 25 17:51:39 user nova-compute[74739]: node.session.err_timeo.abort_timeout = 15
Oct 25 17:51:39 user nova-compute[74739]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 17:51:39 user nova-compute[74739]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 17:51:39 user nova-compute[74739]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.FastAbort = Yes
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.InitialR2T = No
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.ImmediateData = Yes
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.MaxConnections = 1
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 17:51:39 user nova-compute[74739]: node.session.iscsi.ERL = 0
Oct 25 17:51:39 user nova-compute[74739]: node.session.scan = manual
Oct 25 17:51:39 user nova-compute[74739]: node.session.reopen_max = 0
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].address = 172.16.0.220
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].port = 3260
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].startup = manual
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].tcp.window_size = 524288
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].tcp.type_of_service = 0
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].timeo.logout_timeout = 15
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].timeo.login_timeout = 15
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].timeo.auth_timeout = 45
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.DataDigest = None
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.IFMarker = No
Oct 25 17:51:39 user nova-compute[74739]: node.conn[0].iscsi.OFMarker = No
Oct 25 17:51:39 user nova-compute[74739]: # END RECORD
Oct 25 17:51:39 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a701038c-7c2e-4db7-bac8-c100788815fe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1325ab-7d3a-4fa9-b083-6f1a5fb53acc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvhSOefk {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IvhSOefk" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67b5a9-cfba-491e-93ea-41d8957a3f5f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IvhSOefk'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[85757955-6397-427e-a4fe-b6043abb6ae7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[af741029-f0a2-4646-8e96-ae65afe7b056]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:51:39 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:51:39 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:51:39 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.179s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] HCTL ('36', '0', '0', 0) found on session 8 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4322f7c-0536-48e3-870d-0ed3d0d25aa3]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Searching for a device in session 8 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] <== connect_volume: return (207ms) {'type': 'block', 'scsi_wwn': '23233323839313838', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:51:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233323839313838', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2122672527',display_name='tempest-ServerStableDeviceRescueTest-server-2122672527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2122672527',id=4,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODut1pNslwSU4Di0lHh0C6EpfYOPqvghmvMnB4Fe1wEhoRAWbRcGpJBWvX1TZnxT/9xSDgreJ/BHuyJHTnD0o6tmk0d7vRiQepNtyDzSQHOe329v/2YQU9JiN9ugtZpxQ==',key_name='tempest-keypair-1409896089',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9bfb1966da34253bbe550d1dbf97979',ramdisk_id='',reservation_id='r-5vd1zmhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-19504323',owner_user_name='tempest-ServerStableDeviceRescueTest-19504323-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be7a94af5cae47709995a2d16346740c',uuid=cb37a637-7bf4-449d-b291-6986eea005e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "vif_mac": "fa:16:3e:0a:58:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converting VIF {"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "vif_mac": "fa:16:3e:0a:58:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'pci_devices' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.objects.base [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Object Instance<cb37a637-7bf4-449d-b291-6986eea005e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:51:40 user nova-compute[74739]:   <uuid>cb37a637-7bf4-449d-b291-6986eea005e9</uuid>
Oct 25 17:51:40 user nova-compute[74739]:   <name>instance-00000004</name>
Oct 25 17:51:40 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:51:40 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:51:40 user nova-compute[74739]:   <metadata>
Oct 25 17:51:40 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:51:40 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2122672527</nova:name>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:51:39</nova:creationTime>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:51:40 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:51:40 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:owner>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:user uuid="be7a94af5cae47709995a2d16346740c">tempest-ServerStableDeviceRescueTest-19504323-project-member</nova:user>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:project uuid="d9bfb1966da34253bbe550d1dbf97979">tempest-ServerStableDeviceRescueTest-19504323</nova:project>
Oct 25 17:51:40 user nova-compute[74739]:       </nova:owner>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:51:40 user nova-compute[74739]:       <nova:ports>
Oct 25 17:51:40 user nova-compute[74739]:         <nova:port uuid="d7f62b72-2e75-4ead-a8be-5657f0d6b8a1">
Oct 25 17:51:40 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:51:40 user nova-compute[74739]:         </nova:port>
Oct 25 17:51:40 user nova-compute[74739]:       </nova:ports>
Oct 25 17:51:40 user nova-compute[74739]:     </nova:instance>
Oct 25 17:51:40 user nova-compute[74739]:   </metadata>
Oct 25 17:51:40 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:51:40 user nova-compute[74739]:     <system>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="serial">cb37a637-7bf4-449d-b291-6986eea005e9</entry>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="uuid">cb37a637-7bf4-449d-b291-6986eea005e9</entry>
Oct 25 17:51:40 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:51:40 user nova-compute[74739]:     </system>
Oct 25 17:51:40 user nova-compute[74739]:   </sysinfo>
Oct 25 17:51:40 user nova-compute[74739]:   <os>
Oct 25 17:51:40 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:51:40 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:51:40 user nova-compute[74739]:   </os>
Oct 25 17:51:40 user nova-compute[74739]:   <features>
Oct 25 17:51:40 user nova-compute[74739]:     <acpi/>
Oct 25 17:51:40 user nova-compute[74739]:     <apic/>
Oct 25 17:51:40 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:51:40 user nova-compute[74739]:   </features>
Oct 25 17:51:40 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:51:40 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:51:40 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:51:40 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:51:40 user nova-compute[74739]:   </clock>
Oct 25 17:51:40 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:51:40 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:51:40 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:51:40 user nova-compute[74739]:   </cpu>
Oct 25 17:51:40 user nova-compute[74739]:   <devices>
Oct 25 17:51:40 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:51:40 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:51:40 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk"/>
Oct 25 17:51:40 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:51:40 user nova-compute[74739]:     </disk>
Oct 25 17:51:40 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:51:40 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:51:40 user nova-compute[74739]:       <source dev="/dev/sde"/>
Oct 25 17:51:40 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 17:51:40 user nova-compute[74739]:       <serial>1be5522d-af74-404d-bf6b-60f854ada82b</serial>
Oct 25 17:51:40 user nova-compute[74739]:     </disk>
Oct 25 17:51:40 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:51:40 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:51:40 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue"/>
Oct 25 17:51:40 user nova-compute[74739]:       <target dev="vdc" bus="virtio"/>
Oct 25 17:51:40 user nova-compute[74739]:       <boot order="1"/>
Oct 25 17:51:40 user nova-compute[74739]:     </disk>
Oct 25 17:51:40 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:51:40 user nova-compute[74739]:       <mac address="fa:16:3e:0a:58:cf"/>
Oct 25 17:51:40 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:51:40 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:51:40 user nova-compute[74739]:       <target dev="tapd7f62b72-2e"/>
Oct 25 17:51:40 user nova-compute[74739]:     </interface>
Oct 25 17:51:40 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:51:40 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/console.log" append="off"/>
Oct 25 17:51:40 user nova-compute[74739]:     </serial>
Oct 25 17:51:40 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:51:40 user nova-compute[74739]:     <video>
Oct 25 17:51:40 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:51:40 user nova-compute[74739]:     </video>
Oct 25 17:51:40 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:51:40 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:51:40 user nova-compute[74739]:     </rng>
Oct 25 17:51:40 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:51:40 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:51:40 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:51:40 user nova-compute[74739]:     </memballoon>
Oct 25 17:51:40 user nova-compute[74739]:   </devices>
Oct 25 17:51:40 user nova-compute[74739]: </domain>
Oct 25 17:51:40 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:51:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance destroyed successfully.
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:51:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] No VIF found with MAC fa:16:3e:0a:58:cf, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:41 user nova-compute[74739]: WARNING nova.compute.manager [req-084f292c-1c24-4900-b3a6-fcc353014df9 req-7f58d136-e777-4bcb-a858-6a6be112f367 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state rescuing.
Oct 25 17:51:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:51:44 user nova-compute[74739]: WARNING nova.compute.manager [req-1c229636-8253-46fc-8bd1-188649a053f8 req-72b028b1-4265-40eb-965e-0d8176dbabf4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state active and task_state rescuing.
Oct 25 17:51:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6a3c2029-3228-4e05-8190-7eb1eacb1de2 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:51:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:51:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:00 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:00 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:00 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5359e-5c9b-451a-8e5c-9fb0ce57edb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:52:00 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d29ee-10b6-4a59-acd7-42f87ef098dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a] added
Oct 25 17:52:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[19273d77-c243-4a64-93a2-2094f775cd60]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e826b067-4e10-4f38-a4f6-1093eaa0c850]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuUoEqNc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuUoEqNc" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6160a66c-967c-40c7-a83d-f9a3b817512c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SuUoEqNc'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a3e4e9-f7ab-44c4-81af-d5d0a4eec198]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40e27d-e0cf-4d60-acd7-fd5de27a4635]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:00 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:00 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:00 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_requests' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'numa_topology' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:52:01 user nova-compute[74739]: INFO nova.compute.claims [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Claim successful on node user
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800279b-f82f-4a09-91c6-5503330f62a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]
Oct 25 17:52:01 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a29d93-9413-4334-b58b-408080446b36]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e978bd-d95b-4c0c-bc99-fde6fe9aee94]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:01 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c9ee7-b0b0-4a93-8a87-7a1a8bd1603a]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:01 user nova-compute[74739]: INFO nova.network.neutron [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating port 80d38ac3-dd49-49f5-bd49-64f4495084fa with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26233383632666437', 'path': '/dev/sdf'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233383632666437', 'path': '/dev/sdf'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'flavor' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:52:02 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:02 user nova-compute[74739]:   <source dev="/dev/sdf"/>
Oct 25 17:52:02 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:52:02 user nova-compute[74739]:   <serial>ab2f5ae7-580d-4288-880e-8b8102af5b8a</serial>
Oct 25 17:52:02 user nova-compute[74739]: </disk>
Oct 25 17:52:02 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing instance network info cache due to event network-changed-80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No VIF found with MAC fa:16:3e:07:4a:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4b3bfd6d-d65b-44dc-bbc2-6bde802797f8 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.738s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:52:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Creating image(s)
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Refreshing network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG nova.objects.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<a8d9aaf2-caff-47c9-9add-1963381511d5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "f3227b334ba5dd78009b3df0b44dfd345211c889" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "f3227b334ba5dd78009b3df0b44dfd345211c889" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.virt.images [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] 93912557-d520-495a-a221-36c6b412b353 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.part /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updated VIF entry in instance network info cache for port 80d38ac3-dd49-49f5-bd49-64f4495084fa. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bfd11b2e-55cd-4189-8f23-025a8c8d1544 req-baefd914-6686-4a60-b09d-26ab71ceec62 service nova] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.part /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.converted" returned: 0 in 0.289s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "f3227b334ba5dd78009b3df0b44dfd345211c889" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.520s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "f3227b334ba5dd78009b3df0b44dfd345211c889" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "f3227b334ba5dd78009b3df0b44dfd345211c889" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889,backing_fmt=raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889,backing_fmt=raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk 1073741824" returned: 0 in 0.056s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "f3227b334ba5dd78009b3df0b44dfd345211c889" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'migration_context' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<a8d9aaf2-caff-47c9-9add-1963381511d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Rebasing disk image.
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 -F raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:05 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Stashing vm_state: active {{(pid=74739) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:52:06 user nova-compute[74739]: INFO nova.compute.claims [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Claim successful on node user
Oct 25 17:52:06 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating resource usage from migration 832e3d52-9ab1-4042-bc88-7e39d31810a0
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 1.236s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:07 user nova-compute[74739]: INFO nova.compute.manager [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Migrating
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:07 user nova-compute[74739]: INFO nova.compute.rpcapi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 -F raw /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk" returned: 0 in 3.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Ensure instance console log exists: /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start _get_guest_xml network_info=[{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5ef43aa37246b505ffacd20a4922e5d4',container_format='bare',created_at=2023-10-25T17:49:25Z,direct_url=<?>,disk_format='qcow2',id=93912557-d520-495a-a221-36c6b412b353,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-998219364-shelved',owner='6c2a1dd2b0954a74be154b7082170334',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T17:49:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'f17f12a1-c023-4619-aee0-2d3b8c220611', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqtoknAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a8d9aaf2-caff-47c9-9add-1963381511d5', 'attached_at': '', 'detached_at': '', 'volume_id': '69cb53dc-79b3-4e10-ae03-93c970cc8770', 'serial': '69cb53dc-79b3-4e10-ae03-93c970cc8770'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:52:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Starting migrate_disk_and_power_off {{(pid=74739) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5ef43aa37246b505ffacd20a4922e5d4',container_format='bare',created_at=2023-10-25T17:49:25Z,direct_url=<?>,disk_format='qcow2',id=93912557-d520-495a-a221-36c6b412b353,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-998219364-shelved',owner='6c2a1dd2b0954a74be154b7082170334',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T17:49:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.objects.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<a8d9aaf2-caff-47c9-9add-1963381511d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqtoknAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:08 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json" returned: 0 in 0.291s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[74128120-494f-4998-b083-bd76ae8c036a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:52:09 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55230928-6d8f-4325-bc82-244e9bb97cb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770] added
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae6afb9-99f3-48f5-8b55-0a2a748c9880]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f482cc95-a853-444e-8325-42679f3eb2d6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqtoknAH {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uqtoknAH" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c48cab-6107-4433-a40f-9d068d4d62ce]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uqtoknAH'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf478b00-7c29-4ad7-9b5f-90155bd7e529]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cce7fe-4407-419d-90f4-5254b21514a9]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:09 user nova-compute[74739]: WARNING nova.compute.manager [req-273f6f59-d1a2-477d-8cf0-3799496fb988 req-b5a703b2-d919-45ec-9324-5dee82695b42 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state resize_migrating.
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5a04d-1387-4947-8ae6-9adc91f58c49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260]
Oct 25 17:52:09 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b225e34-2a2d-4fd4-9258-46c8254d1cbe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1926b7-b135-479a-b992-3f5e0ce17f54]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:09 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4be172-a65a-4383-a511-2846f2b38fc2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqtoknAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance destroyed successfully.
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a7792b1-73, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4c6236b-f10d-49e9-8926-a0732e3d9aed) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:09 user nova-compute[74739]: INFO os_vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73')
Oct 25 17:52:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:09 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.756s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] <== connect_volume: return (1759ms) {'type': 'block', 'scsi_wwn': '23933303036356634', 'path': '/dev/sdg'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933303036356634', 'path': '/dev/sdg'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.804s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.129791259765625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41293830-3a34-4ef2-a5f1-0e8dd1f91cbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:52:10 user nova-compute[74739]: No targets found.
Oct 25 17:52:10 user nova-compute[74739]: iSNS:
Oct 25 17:52:10 user nova-compute[74739]: No targets found.
Oct 25 17:52:10 user nova-compute[74739]: STATIC:
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:52:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:10 user nova-compute[74739]: FIRMWARE:
Oct 25 17:52:10 user nova-compute[74739]: No targets found.
Oct 25 17:52:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:52:10 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:52:10 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='93912557-d520-495a-a221-36c6b412b353',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-770018984',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:49:30.146004',shelved_host='user',shelved_image_id='93912557-d520-495a-a221-36c6b412b353'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_devices' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff18cc7-02a3-451f-be38-24e0fdf3c6e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.objects.base [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<a8d9aaf2-caff-47c9-9add-1963381511d5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:52:10 user nova-compute[74739]:   <uuid>a8d9aaf2-caff-47c9-9add-1963381511d5</uuid>
Oct 25 17:52:10 user nova-compute[74739]:   <name>instance-00000003</name>
Oct 25 17:52:10 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:52:10 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:52:10 user nova-compute[74739]:   <metadata>
Oct 25 17:52:10 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:52:10 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-998219364</nova:name>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:52:08</nova:creationTime>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:52:10 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:52:10 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:owner>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:user uuid="e140ed4e3e2f4d5abc2e08e1400715de">tempest-AttachVolumeShelveTestJSON-744521439-project-member</nova:user>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:project uuid="6c2a1dd2b0954a74be154b7082170334">tempest-AttachVolumeShelveTestJSON-744521439</nova:project>
Oct 25 17:52:10 user nova-compute[74739]:       </nova:owner>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:root type="image" uuid="93912557-d520-495a-a221-36c6b412b353"/>
Oct 25 17:52:10 user nova-compute[74739]:       <nova:ports>
Oct 25 17:52:10 user nova-compute[74739]:         <nova:port uuid="80d38ac3-dd49-49f5-bd49-64f4495084fa">
Oct 25 17:52:10 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 17:52:10 user nova-compute[74739]:         </nova:port>
Oct 25 17:52:10 user nova-compute[74739]:       </nova:ports>
Oct 25 17:52:10 user nova-compute[74739]:     </nova:instance>
Oct 25 17:52:10 user nova-compute[74739]:   </metadata>
Oct 25 17:52:10 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:52:10 user nova-compute[74739]:     <system>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="serial">a8d9aaf2-caff-47c9-9add-1963381511d5</entry>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="uuid">a8d9aaf2-caff-47c9-9add-1963381511d5</entry>
Oct 25 17:52:10 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:52:10 user nova-compute[74739]:     </system>
Oct 25 17:52:10 user nova-compute[74739]:   </sysinfo>
Oct 25 17:52:10 user nova-compute[74739]:   <os>
Oct 25 17:52:10 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:52:10 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:52:10 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:52:10 user nova-compute[74739]:   </os>
Oct 25 17:52:10 user nova-compute[74739]:   <features>
Oct 25 17:52:10 user nova-compute[74739]:     <acpi/>
Oct 25 17:52:10 user nova-compute[74739]:     <apic/>
Oct 25 17:52:10 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:52:10 user nova-compute[74739]:   </features>
Oct 25 17:52:10 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:52:10 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:52:10 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:52:10 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:52:10 user nova-compute[74739]:   </clock>
Oct 25 17:52:10 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:52:10 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:52:10 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:52:10 user nova-compute[74739]:   </cpu>
Oct 25 17:52:10 user nova-compute[74739]:   <devices>
Oct 25 17:52:10 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:52:10 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:52:10 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk"/>
Oct 25 17:52:10 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:52:10 user nova-compute[74739]:     </disk>
Oct 25 17:52:10 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:52:10 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:10 user nova-compute[74739]:       <source dev="/dev/sdg"/>
Oct 25 17:52:10 user nova-compute[74739]:       <target dev="vdc" bus="virtio"/>
Oct 25 17:52:10 user nova-compute[74739]:       <serial>69cb53dc-79b3-4e10-ae03-93c970cc8770</serial>
Oct 25 17:52:10 user nova-compute[74739]:     </disk>
Oct 25 17:52:10 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:52:10 user nova-compute[74739]:       <mac address="fa:16:3e:df:c6:b0"/>
Oct 25 17:52:10 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:10 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:52:10 user nova-compute[74739]:       <target dev="tap80d38ac3-dd"/>
Oct 25 17:52:10 user nova-compute[74739]:     </interface>
Oct 25 17:52:10 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:52:10 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/console.log" append="off"/>
Oct 25 17:52:10 user nova-compute[74739]:     </serial>
Oct 25 17:52:10 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:52:10 user nova-compute[74739]:     <video>
Oct 25 17:52:10 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:10 user nova-compute[74739]:     </video>
Oct 25 17:52:10 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:52:10 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:52:10 user nova-compute[74739]:     </rng>
Oct 25 17:52:10 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:52:10 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:52:10 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:52:10 user nova-compute[74739]:     </memballoon>
Oct 25 17:52:10 user nova-compute[74739]:   </devices>
Oct 25 17:52:10 user nova-compute[74739]: </domain>
Oct 25 17:52:10 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='93912557-d520-495a-a221-36c6b412b353',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-770018984',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:49:30.146004',shelved_host='user',shelved_image_id='93912557-d520-495a-a221-36c6b412b353'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_vif [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0669993e-a4a0-5da5-aad7-7ff2a17ad02a', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac268ee-2d84-4b10-99d4-8f93ea0887a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:10 user nova-compute[74739]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a'): ({'sdf'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Removing single pathed devices sdf {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80d38ac3-dd, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80d38ac3-dd, col_values=(('qos', UUID('6b65abd0-cc2e-4790-a03e-eba70967a9ef')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80d38ac3-dd, col_values=(('external_ids', {'iface-id': '80d38ac3-dd49-49f5-bd49-64f4495084fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:c6:b0', 'vm-uuid': 'a8d9aaf2-caff-47c9-9add-1963381511d5'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Applying migration context for instance 7926c5ce-2435-4493-813f-4dca6e1f204f as it has an incoming, in-progress migration 832e3d52-9ab1-4042-bc88-7e39d31810a0. Migration status is migrating {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 17:52:10 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating resource usage from migration 832e3d52-9ab1-4042-bc88-7e39d31810a0
Oct 25 17:52:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:10 user nova-compute[74739]: INFO os_vif [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd')
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[771c0613-a635-492e-bf3a-464eae59b0f8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9520d22-592c-4ce7-8b29-59bace651056]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flushing IO for device /dev/sdf {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bdcd3887-b9d6-42f3-b758-1410e22af542 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (3998dc2a-c940-46be-8c01-65f11782a00e): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Migration 832e3d52-9ab1-4042-bc88-7e39d31810a0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e1afb7-c0bb-478f-be20-62739f6c8c54]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No VIF found with MAC fa:16:3e:df:c6:b0, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b275d4e-2044-4469-8c91-5d4c57dcaf02]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:52:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6177d9c4-0efb-459c-b2c4-9c06f103e141]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8a49bf-f29d-40e6-9e58-f1d58c74a749]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]
Oct 25 17:52:11 user nova-compute[74739]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c35ab2-f4b6-4fd1-9f68-bf37f9f46b9d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== disconnect_volume: return (1222ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:11 user nova-compute[74739]: WARNING nova.compute.manager [req-7b66a3af-9bc0-4644-9575-03841d1459fb req-5f409908-613c-4a87-9cad-7df0cbdb90b5 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state resize_migrating.
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize/disk /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "cp -r /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize/disk /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk" returned: 0 in 0.384s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize/disk.info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk.info {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "cp -r /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize/disk.info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk.info" returned: 0 in 0.050s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:12 user nova-compute[74739]: WARNING nova.compute.manager [req-501f578b-43c8-4edd-a44b-7719b9d746fa req-c018af0f-d724-4e37-9068-ef116255cf82 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 17:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Port 1a7792b1-73e4-43a3-b106-01d131c00444 binding to destination host user is already ACTIVE {{(pid=74739) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:13 user nova-compute[74739]: INFO nova.compute.manager [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Rescuing
Oct 25 17:52:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG nova.network.neutron [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:15 user nova-compute[74739]: WARNING nova.compute.manager [req-afb4f714-e31b-4137-a3a5-5e1e4845adf7 req-9b3a1abd-1420-4425-8e9b-9753a22d32da service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 17:52:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance destroyed successfully.
Oct 25 17:52:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Attempting a stable device rescue
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 17:52:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Creating image(s)
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG os_brick.utils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "3349462cf9293c9e30a7b193df55a8845c733899" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3349462cf9293c9e30a7b193df55a8845c733899" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5201257-5fc2-41b8-8b9e-f813eca5d830]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd8eec-60f3-4afa-99df-9936b54c0575]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[80058da2-b2f5-4abe-b389-255b0318fe2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec51e480-bf29-4a95-bd1a-51f584677093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:52:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance spawned successfully.
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:16 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b054410b-1e09-42ad-a104-cf62755bb2ee]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG os_brick.utils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== get_connector_properties: return (1112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.part --force-share --output=json" returned: 0 in 0.303s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG nova.virt.images [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] bf57365f-442f-40dc-959d-fb9dd683dc0d was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:52:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.part /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:17 user nova-compute[74739]: WARNING nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state active and task_state rescuing.
Oct 25 17:52:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:17 user nova-compute[74739]: WARNING nova.compute.manager [req-e8ec8d7e-f680-4c19-9f99-05acf6340ea5 req-2f53f516-99bc-4f8a-a7bd-694cc7056e2a service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state active and task_state rescuing.
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.part /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.converted" returned: 0 in 0.422s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899.converted --force-share --output=json" returned: 0 in 0.292s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3349462cf9293c9e30a7b193df55a8845c733899" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.090s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "3349462cf9293c9e30a7b193df55a8845c733899" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3349462cf9293c9e30a7b193df55a8845c733899" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fc13f1ce-dd6d-44f1-9a23-3ee9c8dbeaa6 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 59.701s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899 --force-share --output=json" returned: 0 in 0.252s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899,backing_fmt=raw /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899,backing_fmt=raw /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue" returned: 0 in 0.069s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3349462cf9293c9e30a7b193df55a8845c733899" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'migration_context' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<3ebb8df7-813e-4118-9689-f56934edf958> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start _get_guest_xml network_info=[{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:44:d9:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf57365f-442f-40dc-959d-fb9dd683dc0d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd6570e6c-d546-4e63-a74f-792ec8a9ae31', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3ebb8df7-813e-4118-9689-f56934edf958', 'attached_at': '', 'detached_at': '', 'volume_id': '72ee0394-046b-4829-8988-a682bfacb118', 'serial': '72ee0394-046b-4829-8988-a682bfacb118'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<3ebb8df7-813e-4118-9689-f56934edf958> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<3ebb8df7-813e-4118-9689-f56934edf958> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:18 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:18 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<3ebb8df7-813e-4118-9689-f56934edf958> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:18 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:18 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:18 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[798db1e4-777d-4419-98e1-d056111876e9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = srJwcgim\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 17:52:18 user nova-compute[74739]: node.name = iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:52:18 user nova-compute[74739]: node.tpgt = -1
Oct 25 17:52:18 user nova-compute[74739]: node.startup = automatic
Oct 25 17:52:18 user nova-compute[74739]: node.leading_login = No
Oct 25 17:52:18 user nova-compute[74739]: iface.iscsi_ifacename = default
Oct 25 17:52:18 user nova-compute[74739]: iface.net_ifacename = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.ipaddress = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.prefix_len = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.hwaddress = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.transport_name = tcp
Oct 25 17:52:18 user nova-compute[74739]: iface.initiatorname = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.vlan_id = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.vlan_priority = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.vlan_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.iface_num = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.mtu = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.port = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.bootproto = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.subnet_mask = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.gateway = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_alt_client_id = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_dns = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_learn_iqn = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_vendor_id_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_vendor_id = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.dhcp_slp_da = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.fragmentation = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.gratuitous_arp = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.incoming_forwarding = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.tos_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.tos = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.ttl = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.delayed_ack = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.tcp_nagle = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.tcp_wsf_state = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.tcp_wsf = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.tcp_timer_scale = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.tcp_timestamp = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.redirect = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.def_task_mgmt_timeout = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.header_digest = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.data_digest = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.immediate_data = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.initial_r2t = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.data_seq_inorder = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.data_pdu_inorder = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.erl = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.max_receive_data_len = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.first_burst_len = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.max_outstanding_r2t = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.max_burst_len = 0
Oct 25 17:52:18 user nova-compute[74739]: iface.chap_auth = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.bidi_chap = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.strict_login_compliance = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.discovery_auth = <empty>
Oct 25 17:52:18 user nova-compute[74739]: iface.discovery_logout = <empty>
Oct 25 17:52:18 user nova-compute[74739]: node.discovery_address = <empty>
Oct 25 17:52:18 user nova-compute[74739]: node.discovery_port = 0
Oct 25 17:52:18 user nova-compute[74739]: node.discovery_type = static
Oct 25 17:52:18 user nova-compute[74739]: node.session.initial_cmdsn = 0
Oct 25 17:52:18 user nova-compute[74739]: node.session.initial_login_retry_max = 8
Oct 25 17:52:18 user nova-compute[74739]: node.session.xmit_thread_priority = -20
Oct 25 17:52:18 user nova-compute[74739]: node.session.cmds_max = 128
Oct 25 17:52:18 user nova-compute[74739]: node.session.queue_depth = 32
Oct 25 17:52:18 user nova-compute[74739]: node.session.nr_sessions = 1
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.authmethod = CHAP
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.username = srJwcgim
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.password = ***
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.username_in = <empty>
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.password_in = <empty>
Oct 25 17:52:18 user nova-compute[74739]: node.session.auth.chap_algs = MD5
Oct 25 17:52:18 user nova-compute[74739]: node.session.timeo.replacement_timeout = 120
Oct 25 17:52:18 user nova-compute[74739]: node.session.err_timeo.abort_timeout = 15
Oct 25 17:52:18 user nova-compute[74739]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 17:52:18 user nova-compute[74739]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 17:52:18 user nova-compute[74739]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.FastAbort = Yes
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.InitialR2T = No
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.ImmediateData = Yes
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.MaxConnections = 1
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 17:52:18 user nova-compute[74739]: node.session.iscsi.ERL = 0
Oct 25 17:52:18 user nova-compute[74739]: node.session.scan = manual
Oct 25 17:52:18 user nova-compute[74739]: node.session.reopen_max = 0
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].address = 172.16.0.220
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].port = 3260
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].startup = manual
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].tcp.window_size = 524288
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].tcp.type_of_service = 0
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].timeo.logout_timeout = 15
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].timeo.login_timeout = 15
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].timeo.auth_timeout = 45
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.DataDigest = None
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.IFMarker = No
Oct 25 17:52:18 user nova-compute[74739]: node.conn[0].iscsi.OFMarker = No
Oct 25 17:52:18 user nova-compute[74739]: # END RECORD
Oct 25 17:52:18 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b501ae0-7c8e-46fd-b310-b7f6bd3f152c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c01dc9-c869-4740-a1fd-d9f94088523c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srJwcgim {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v srJwcgim" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94845324-5f08-4cd0-9ecd-d9023836a0ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'srJwcgim'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.140s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[103799d5-2cee-483d-91dd-8e0165abbbc7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a2bed7-56ac-4679-8904-df6cefb919ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:18 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:18 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:18 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] HCTL ('33', '0', '0', 0) found on session 6 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f62ecb-6093-4879-b03a-c3eba318f0ce]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching for a device in session 6 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.296s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== connect_volume: return (299ms) {'type': 'block', 'scsi_wwn': '23637336363633837', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637336363633837', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1931905537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1931905537',id=13,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-fo89rnny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:50:58Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=3ebb8df7-813e-4118-9689-f56934edf958,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:44:d9:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:44:d9:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.objects.base [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<3ebb8df7-813e-4118-9689-f56934edf958> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:52:18 user nova-compute[74739]:   <uuid>3ebb8df7-813e-4118-9689-f56934edf958</uuid>
Oct 25 17:52:18 user nova-compute[74739]:   <name>instance-0000000d</name>
Oct 25 17:52:18 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:52:18 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:52:18 user nova-compute[74739]:   <metadata>
Oct 25 17:52:18 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:52:18 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1931905537</nova:name>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:52:18</nova:creationTime>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:52:18 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:52:18 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:owner>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 17:52:18 user nova-compute[74739]:       </nova:owner>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:52:18 user nova-compute[74739]:       <nova:ports>
Oct 25 17:52:18 user nova-compute[74739]:         <nova:port uuid="9eacc6fc-2f3b-4670-93ec-9e7f49969255">
Oct 25 17:52:18 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:52:18 user nova-compute[74739]:         </nova:port>
Oct 25 17:52:18 user nova-compute[74739]:       </nova:ports>
Oct 25 17:52:18 user nova-compute[74739]:     </nova:instance>
Oct 25 17:52:18 user nova-compute[74739]:   </metadata>
Oct 25 17:52:18 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:52:18 user nova-compute[74739]:     <system>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="serial">3ebb8df7-813e-4118-9689-f56934edf958</entry>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="uuid">3ebb8df7-813e-4118-9689-f56934edf958</entry>
Oct 25 17:52:18 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:52:18 user nova-compute[74739]:     </system>
Oct 25 17:52:18 user nova-compute[74739]:   </sysinfo>
Oct 25 17:52:18 user nova-compute[74739]:   <os>
Oct 25 17:52:18 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:52:18 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:52:18 user nova-compute[74739]:   </os>
Oct 25 17:52:18 user nova-compute[74739]:   <features>
Oct 25 17:52:18 user nova-compute[74739]:     <acpi/>
Oct 25 17:52:18 user nova-compute[74739]:     <apic/>
Oct 25 17:52:18 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:52:18 user nova-compute[74739]:   </features>
Oct 25 17:52:18 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:52:18 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:52:18 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:52:18 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:52:18 user nova-compute[74739]:   </clock>
Oct 25 17:52:18 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:52:18 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:52:18 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:52:18 user nova-compute[74739]:   </cpu>
Oct 25 17:52:18 user nova-compute[74739]:   <devices>
Oct 25 17:52:18 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:52:18 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:18 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 17:52:18 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:52:18 user nova-compute[74739]:       <serial>72ee0394-046b-4829-8988-a682bfacb118</serial>
Oct 25 17:52:18 user nova-compute[74739]:     </disk>
Oct 25 17:52:18 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:52:18 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:52:18 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue"/>
Oct 25 17:52:18 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 17:52:18 user nova-compute[74739]:       <boot order="1"/>
Oct 25 17:52:18 user nova-compute[74739]:     </disk>
Oct 25 17:52:18 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:52:18 user nova-compute[74739]:       <mac address="fa:16:3e:44:d9:50"/>
Oct 25 17:52:18 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:18 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:52:18 user nova-compute[74739]:       <target dev="tap9eacc6fc-2f"/>
Oct 25 17:52:18 user nova-compute[74739]:     </interface>
Oct 25 17:52:18 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:52:18 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/console.log" append="off"/>
Oct 25 17:52:18 user nova-compute[74739]:     </serial>
Oct 25 17:52:18 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:52:18 user nova-compute[74739]:     <video>
Oct 25 17:52:18 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:18 user nova-compute[74739]:     </video>
Oct 25 17:52:18 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:52:18 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:52:18 user nova-compute[74739]:     </rng>
Oct 25 17:52:18 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:52:18 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:52:18 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:52:18 user nova-compute[74739]:     </memballoon>
Oct 25 17:52:18 user nova-compute[74739]:   </devices>
Oct 25 17:52:18 user nova-compute[74739]: </domain>
Oct 25 17:52:18 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:52:18 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance destroyed successfully.
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:18 user nova-compute[74739]: INFO nova.compute.manager [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Attaching volume ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 to /dev/vdb
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:44:d9:50, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.utils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d6e458-b413-4bb8-bf15-b1626140b321]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbc51a-3353-4005-85e5-a85c0f2e2f4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b26f1-d10f-4970-909c-b3492577c3bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a3f52b-3161-49c4-b460-ed1a9f771961]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:18 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:52:18 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b125bd-ccb9-4fc0-9e6e-4ef6b23b2b4b]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG os_brick.utils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:18 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating existing volume attachment record: c36ba378-2585-4f2b-a01f-a9886a4e3c7e {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:52:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:20 user nova-compute[74739]: INFO nova.compute.manager [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Detaching volume 5f74b52c-0eb8-4301-99be-83dd9daa2074
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:20 user nova-compute[74739]: WARNING nova.compute.manager [req-b3696a91-000f-467a-b92c-373f42ca8a87 req-373ee8a8-496e-48a2-80cf-b40d3fd9a1f5 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state active and task_state rescuing.
Oct 25 17:52:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:20 user nova-compute[74739]: INFO nova.virt.block_device [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Attempting to driver detach volume 5f74b52c-0eb8-4301-99be-83dd9daa2074 from mountpoint /dev/vdb
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Attempting to detach device vdb from instance bdcd3887-b9d6-42f3-b758-1410e22af542 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:52:20 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:20 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:52:20 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:52:20 user nova-compute[74739]:   <serial>5f74b52c-0eb8-4301-99be-83dd9daa2074</serial>
Oct 25 17:52:20 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:52:20 user nova-compute[74739]: </disk>
Oct 25 17:52:20 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:52:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully detached device vdb from instance bdcd3887-b9d6-42f3-b758-1410e22af542 from the persistent domain config.
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcd3887-b9d6-42f3-b758-1410e22af542 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:52:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:52:20 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:20 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:52:20 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:52:20 user nova-compute[74739]:   <serial>5f74b52c-0eb8-4301-99be-83dd9daa2074</serial>
Oct 25 17:52:20 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:52:20 user nova-compute[74739]: </disk>
Oct 25 17:52:20 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:52:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:52:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:22 user nova-compute[74739]: WARNING nova.compute.manager [req-b15a7493-d3ab-4644-9b3e-81f18b2be8a9 req-d3c5bfad-e13e-4126-8c60-ae7b7ef83914 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state active and task_state rescuing.
Oct 25 17:52:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-78420240-6cc3-4bee-98d3-b85c6ebae445 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:52:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Starting finish_migration {{(pid=74739) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 17:52:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Creating image(s)
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk. size=21474836480 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk 21474836480 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk 21474836480" returned: 0 in 0.051s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Ensure instance console log exists: /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start _get_guest_xml network_info=[{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '57cb6cb8-9a6a-490d-9978-ede601d9c40e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7926c5ce-2435-4493-813f-4dca6e1f204f', 'attached_at': '2023-10-25T17:52:40.000000', 'detached_at': '', 'volume_id': 'ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'serial': 'ab2f5ae7-580d-4288-880e-8b8102af5b8a'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:52:40 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:40 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:40 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:40 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:40 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34aa196-7392-4e74-aee3-e14043c8f54c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:52:40 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.102s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b4fd02-e504-4789-9522-e5cf03d4e084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a] added
Oct 25 17:52:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d304c3-196f-47e6-bbca-318c1b5d5fc2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b1efd-dad4-4364-91d3-a1d62942fa5f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuUoEqNc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuUoEqNc" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11743429-8a6d-43ff-9cc1-6496341c07e3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SuUoEqNc'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[679e7e47-9039-460e-aa4a-8b6b7d4948cb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[654db4dc-bf1e-49d3-9b14-3f27ffc7ea92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:41 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:41 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc1712c-0512-4727-be76-83cb5f6bd3c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]
Oct 25 17:52:41 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:41 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fae600-56a8-47b0-8947-f6b916ca70b1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e3d32-df30-4cf2-a5c2-5d2537152bbb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:41 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:41 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:41 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.463s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b902052-62ac-4eee-b2e7-34c71960ddce]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:41 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcd3887-b9d6-42f3-b758-1410e22af542 is timed out.
Oct 25 17:52:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully detached device vdb from instance bdcd3887-b9d6-42f3-b758-1410e22af542 from the live domain config.
Oct 25 17:52:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSafcgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:41 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.506s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '26233383632666437', 'path': '/dev/sdf'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233383632666437', 'path': '/dev/sdf'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.937s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[553df450-f8c7-42fb-8876-1298196911bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:52:42 user nova-compute[74739]: No targets found.
Oct 25 17:52:42 user nova-compute[74739]: iSNS:
Oct 25 17:52:42 user nova-compute[74739]: No targets found.
Oct 25 17:52:42 user nova-compute[74739]: STATIC:
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:52:42 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:42 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:42 user nova-compute[74739]: FIRMWARE:
Oct 25 17:52:42 user nova-compute[74739]: No targets found.
Oct 25 17:52:42 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:52:42 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:52:42 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:52:42 user nova-compute[74739]:   <uuid>7926c5ce-2435-4493-813f-4dca6e1f204f</uuid>
Oct 25 17:52:42 user nova-compute[74739]:   <name>instance-00000005</name>
Oct 25 17:52:42 user nova-compute[74739]:   <memory>2097152</memory>
Oct 25 17:52:42 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:52:42 user nova-compute[74739]:   <metadata>
Oct 25 17:52:42 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:52:42 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherB-server-660238142</nova:name>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:52:40</nova:creationTime>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:flavor name="m1.small">
Oct 25 17:52:42 user nova-compute[74739]:         <nova:memory>2048</nova:memory>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:disk>20</nova:disk>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:52:42 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:owner>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:user uuid="4ace8d9977bb4a0f869bec3b8e79e2cd">tempest-ServerActionsTestOtherB-1769246220-project-member</nova:user>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:project uuid="8d1d84fb43034e9d9f6cf85063763000">tempest-ServerActionsTestOtherB-1769246220</nova:project>
Oct 25 17:52:42 user nova-compute[74739]:       </nova:owner>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:52:42 user nova-compute[74739]:       <nova:ports>
Oct 25 17:52:42 user nova-compute[74739]:         <nova:port uuid="1a7792b1-73e4-43a3-b106-01d131c00444">
Oct 25 17:52:42 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 17:52:42 user nova-compute[74739]:         </nova:port>
Oct 25 17:52:42 user nova-compute[74739]:       </nova:ports>
Oct 25 17:52:42 user nova-compute[74739]:     </nova:instance>
Oct 25 17:52:42 user nova-compute[74739]:   </metadata>
Oct 25 17:52:42 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:52:42 user nova-compute[74739]:     <system>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="serial">7926c5ce-2435-4493-813f-4dca6e1f204f</entry>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="uuid">7926c5ce-2435-4493-813f-4dca6e1f204f</entry>
Oct 25 17:52:42 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:52:42 user nova-compute[74739]:     </system>
Oct 25 17:52:42 user nova-compute[74739]:   </sysinfo>
Oct 25 17:52:42 user nova-compute[74739]:   <os>
Oct 25 17:52:42 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:52:42 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:52:42 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:52:42 user nova-compute[74739]:   </os>
Oct 25 17:52:42 user nova-compute[74739]:   <features>
Oct 25 17:52:42 user nova-compute[74739]:     <acpi/>
Oct 25 17:52:42 user nova-compute[74739]:     <apic/>
Oct 25 17:52:42 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:52:42 user nova-compute[74739]:   </features>
Oct 25 17:52:42 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:52:42 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:52:42 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:52:42 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:52:42 user nova-compute[74739]:   </clock>
Oct 25 17:52:42 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:52:42 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:52:42 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:52:42 user nova-compute[74739]:   </cpu>
Oct 25 17:52:42 user nova-compute[74739]:   <devices>
Oct 25 17:52:42 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:52:42 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:52:42 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk"/>
Oct 25 17:52:42 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:52:42 user nova-compute[74739]:     </disk>
Oct 25 17:52:42 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:52:42 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:42 user nova-compute[74739]:       <source dev="/dev/sdf"/>
Oct 25 17:52:42 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 17:52:42 user nova-compute[74739]:       <serial>ab2f5ae7-580d-4288-880e-8b8102af5b8a</serial>
Oct 25 17:52:42 user nova-compute[74739]:     </disk>
Oct 25 17:52:42 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:52:42 user nova-compute[74739]:       <mac address="fa:16:3e:07:4a:54"/>
Oct 25 17:52:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:42 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:52:42 user nova-compute[74739]:       <target dev="tap1a7792b1-73"/>
Oct 25 17:52:42 user nova-compute[74739]:     </interface>
Oct 25 17:52:42 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:52:42 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/console.log" append="off"/>
Oct 25 17:52:42 user nova-compute[74739]:     </serial>
Oct 25 17:52:42 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:52:42 user nova-compute[74739]:     <video>
Oct 25 17:52:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:42 user nova-compute[74739]:     </video>
Oct 25 17:52:42 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:52:42 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:52:42 user nova-compute[74739]:     </rng>
Oct 25 17:52:42 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:52:42 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:52:42 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:52:42 user nova-compute[74739]:     </memballoon>
Oct 25 17:52:42 user nova-compute[74739]:   </devices>
Oct 25 17:52:42 user nova-compute[74739]: </domain>
Oct 25 17:52:42 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-350208022-network", "vif_mac": "fa:16:3e:07:4a:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ba9dc-4699-49af-a6fd-70de7b643d5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd11d1c8e-589b-5449-88c9-cd513b3018b6', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a7792b1-73, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a7792b1-73, col_values=(('qos', UUID('2561b958-fc43-4f25-95f9-e6f06ebe328d')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a7792b1-73, col_values=(('external_ids', {'iface-id': '1a7792b1-73e4-43a3-b106-01d131c00444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:4a:54', 'vm-uuid': '7926c5ce-2435-4493-813f-4dca6e1f204f'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:42 user nova-compute[74739]: INFO os_vif [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73')
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43fdf1b-4939-458b-af6a-c2fab6257b64]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:42 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 (non-flash)
Oct 25 17:52:42 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:42 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc32d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[23091557-e512-420f-8e7d-71cd62f3674e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663e9a8-c2ec-4a73-9ce0-954cf0b3e4b5]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] No VIF found with MAC fa:16:3e:07:4a:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6b604-322e-4112-aa7d-dd98f88f492c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2112ec-eca2-4459-b55f-cdb350e02347]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7762c396-4e32-43c8-a255-e1861fbed112]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d74ebc-fd72-4b2b-adfa-e601779c0b7a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260]
Oct 25 17:52:42 user nova-compute[74739]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:42 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba238f92-fb2c-4a68-a807-4c8ecf727914]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== disconnect_volume: return (1367ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:43 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cc3343-de4e-4c90-8023-9e58b9e12708]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:52:43 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77ad08-f6b9-40c5-9647-5b947ef2661a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293] added
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9700d41e-5a36-41a8-ac7d-9a1c132f580b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3fec8d-63a0-42d1-9e2f-c542b79ca208]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzhWsRak {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzhWsRak" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d1ea88-a414-410d-8299-4c13f6aa4240]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzhWsRak'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60cfef0-df4b-414f-90c2-5a81acf3d48f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d1c58-567b-4213-be00-0f60434ede03]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG nova.objects.instance [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0c703b-bab6-4d26-96f9-c1c0de38555d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]
Oct 25 17:52:43 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea3ae79-c979-4edc-a498-b4202e0ae3f4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-65993801-60f8-4733-b9af-b700c7017c9b tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.358s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.151s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:43 user nova-compute[74739]: INFO nova.compute.manager [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Terminating instance
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd63517f-bf97-446b-819a-94ea25b01807]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:43 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc514dd-30f6-4a97-ae3d-55ef58f02249]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Instance destroyed successfully.
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'resources' on Instance uuid bdcd3887-b9d6-42f3-b758-1410e22af542 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1887983099',display_name='tempest-VolumesSnapshotTestJSON-instance-1887983099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1887983099',id=10,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgSk72kfnBLo7p1zeXIL+vNdelFDzc7Jz8d9B7GqSAfBuHsH6tHlFrFumZI281dlSZTxR6AInaRpfSMI2A+E3XGZkn8lESWzGN60dfbjwuyuhGRvaYIjdLuYcaPDsxNhg==',key_name='tempest-keypair-2016874935',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-3w1tmzls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=bdcd3887-b9d6-42f3-b758-1410e22af542,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "fab33d97-c0af-43d1-bea2-5b862371e93e", "address": "fa:16:3e:ad:71:5d", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfab33d97-c0", "ovs_interfaceid": "fab33d97-c0af-43d1-bea2-5b862371e93e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_vif [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfab33d97-c0, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=847dc0ff-ddb8-404a-9d3e-8ff5a3d5db6b) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: INFO os_vif [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:71:5d,bridge_name='br-int',has_traffic_filtering=True,id=fab33d97-c0af-43d1-bea2-5b862371e93e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfab33d97-c0')
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSafcgCW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:44 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:44 user nova-compute[74739]: WARNING nova.compute.manager [req-91a381f9-0874-45c9-9b7b-ea474436b238 req-b02e7f9e-d586-453f-adfd-0d20c9fbb462 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state resize_finish.
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '23336373238323165', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336373238323165', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.140s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6ba46e-a539-4f0c-958c-f3d08b83e0fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:52:44 user nova-compute[74739]: No targets found.
Oct 25 17:52:44 user nova-compute[74739]: iSNS:
Oct 25 17:52:44 user nova-compute[74739]: No targets found.
Oct 25 17:52:44 user nova-compute[74739]: STATIC:
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:52:44 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:52:44 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:52:44 user nova-compute[74739]: FIRMWARE:
Oct 25 17:52:44 user nova-compute[74739]: No targets found.
Oct 25 17:52:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:52:44 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:52:44 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f74b52c-0eb8-4301-99be-83dd9daa2074', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:52:44 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:52:44 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:52:44 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:52:44 user nova-compute[74739]:   <serial>ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293</serial>
Oct 25 17:52:44 user nova-compute[74739]: </disk>
Oct 25 17:52:44 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4f6641-1ae9-4860-ac2d-c7e6867a425d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbfed6e-bd3f-49dd-9322-71a32556f788]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:52:44 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:52:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec135bd0>, {}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Disconnecting from: [] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.103s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== disconnect_volume: return (243ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:52:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Deleting instance files /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542_del
Oct 25 17:52:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Deletion of /opt/stack/data/nova/instances/bdcd3887-b9d6-42f3-b758-1410e22af542_del complete
Oct 25 17:52:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:45 user nova-compute[74739]: INFO nova.compute.manager [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No VIF found with MAC fa:16:3e:73:f5:2d, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2ee544a6-924d-45bc-b0fc-63a53091fc6c tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.838s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:52:45 user nova-compute[74739]: INFO nova.compute.claims [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Claim successful on node user
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:46 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Took 1.12 seconds to deallocate network for instance.
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-63007396-64cc-4c7c-b31b-0e1c454b44a1 req-8bb77c8b-009c-4b16-8ef0-a71c3cdd862e service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Received event network-vif-deleted-fab33d97-c0af-43d1-bea2-5b862371e93e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:46 user nova-compute[74739]: INFO nova.compute.manager [req-63007396-64cc-4c7c-b31b-0e1c454b44a1 req-8bb77c8b-009c-4b16-8ef0-a71c3cdd862e service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Neutron deleted interface fab33d97-c0af-43d1-bea2-5b862371e93e; detaching it from the instance and deleting it from the info cache
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.network.neutron [req-63007396-64cc-4c7c-b31b-0e1c454b44a1 req-8bb77c8b-009c-4b16-8ef0-a71c3cdd862e service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:46 user nova-compute[74739]: WARNING nova.volume.cinder [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Attachment 3ef89e2c-6041-4ac5-a9ea-f48195e77fd8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3ef89e2c-6041-4ac5-a9ea-f48195e77fd8. (HTTP 404) (Request-ID: req-dadb93e1-d40e-4857-a4aa-026e69c5736e)
Oct 25 17:52:46 user nova-compute[74739]: INFO nova.compute.manager [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Took 0.04 seconds to detach 1 volumes for instance.
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-63007396-64cc-4c7c-b31b-0e1c454b44a1 req-8bb77c8b-009c-4b16-8ef0-a71c3cdd862e service nova] [instance: bdcd3887-b9d6-42f3-b758-1410e22af542] Detach interface failed, port_id=fab33d97-c0af-43d1-bea2-5b862371e93e, reason: Instance bdcd3887-b9d6-42f3-b758-1410e22af542 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:52:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:52:46 user nova-compute[74739]: INFO nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Booting with volume d70c0f25-9b74-4984-a309-c8ddffeae443 at /dev/vda
Oct 25 17:52:46 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:46 user nova-compute[74739]: WARNING nova.compute.manager [req-e720f635-d497-439c-9f30-0ef410226076 req-289f025d-0bb6-4616-939e-fad8ab399cb2 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state active and task_state resize_finish.
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e4808f-473f-46b3-b26e-c6800a542cff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f18d8-cb58-4e73-ab68-7b7372e01f59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d156e-696c-4dea-b579-282ec64b329e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[82659821-b639-4132-b89e-d85cb6a65d11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.policy [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa6bda843240427eb6f7f95a38718afb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7dc105cff340a4810f5d05bceac2b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:52:47 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99089f-cb2a-4051-8c2c-0540a0e8d675]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating existing volume attachment record: 5bd92763-bd91-4b97-83e6-7edf2bee447d {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:52:47 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance running successfully.
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Failed to set time: agent not configured {{(pid=74739) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1f0685da-b831-43e6-a53a-c130cb285b14 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] finish_migration finished successfully. {{(pid=74739) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.894s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:47 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Deleted allocations for instance bdcd3887-b9d6-42f3-b758-1410e22af542
Oct 25 17:52:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-999a103f-3d45-4ffd-913f-184a6afd23e9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "bdcd3887-b9d6-42f3-b758-1410e22af542" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.675s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully created port: 5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully created port: 4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:49 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:52:49 user nova-compute[74739]: INFO nova.compute.claims [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Claim successful on node user
Oct 25 17:52:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully created port: 4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.690s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:52:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully created port: 7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.policy [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c88a22f5a64ecfbf4d00e1e01e836f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd857f6b59a4255b30b0449aef675c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:52:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Creating image(s)
Oct 25 17:52:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "/opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "/opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "/opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk 1073741824" returned: 0 in 0.064s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Successfully created port: 728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.254s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully created port: ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Cannot resize image /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Ensure instance console log exists: /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Successfully updated port: 728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquired lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-changed-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Refreshing instance network info cache due to event network-changed-728bb0b9-cfcf-4876-b97b-02109cd837da. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] Acquiring lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: 5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port 5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:52 user nova-compute[74739]: DEBUG nova.network.neutron [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updating instance_info_cache with network_info: [{"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Releasing lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Instance network_info: |[{"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] Acquired lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Refreshing network info cache for port 728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Start _get_guest_xml network_info=[{"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:52:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850451263',display_name='tempest-VolumesAdminNegativeTest-server-1850451263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850451263',id=16,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIoB4dyasREWrS4wKusYeqm5Qz8Jy+5wPEkzIQdflH1L+u+IWao1RPoHl38CbALMfqLeBDE36AlUkQ2Vj82frRS4TrhChUitrma84DX1cTPnuFp6diNYP8p6uTnvfzWA==',key_name='tempest-keypair-1607306597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-ozo71di3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=02425b58-f6d0-49f6-bb07-b17608560557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'pci_devices' on Instance uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:52:53 user nova-compute[74739]:   <uuid>02425b58-f6d0-49f6-bb07-b17608560557</uuid>
Oct 25 17:52:53 user nova-compute[74739]:   <name>instance-00000010</name>
Oct 25 17:52:53 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:52:53 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:52:53 user nova-compute[74739]:   <metadata>
Oct 25 17:52:53 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:52:53 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1850451263</nova:name>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:52:53</nova:creationTime>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:52:53 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:52:53 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:owner>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:user uuid="59c88a22f5a64ecfbf4d00e1e01e836f">tempest-VolumesAdminNegativeTest-1830493659-project-member</nova:user>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:project uuid="afd857f6b59a4255b30b0449aef675c0">tempest-VolumesAdminNegativeTest-1830493659</nova:project>
Oct 25 17:52:53 user nova-compute[74739]:       </nova:owner>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:52:53 user nova-compute[74739]:       <nova:ports>
Oct 25 17:52:53 user nova-compute[74739]:         <nova:port uuid="728bb0b9-cfcf-4876-b97b-02109cd837da">
Oct 25 17:52:53 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 17:52:53 user nova-compute[74739]:         </nova:port>
Oct 25 17:52:53 user nova-compute[74739]:       </nova:ports>
Oct 25 17:52:53 user nova-compute[74739]:     </nova:instance>
Oct 25 17:52:53 user nova-compute[74739]:   </metadata>
Oct 25 17:52:53 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:52:53 user nova-compute[74739]:     <system>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="serial">02425b58-f6d0-49f6-bb07-b17608560557</entry>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="uuid">02425b58-f6d0-49f6-bb07-b17608560557</entry>
Oct 25 17:52:53 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:52:53 user nova-compute[74739]:     </system>
Oct 25 17:52:53 user nova-compute[74739]:   </sysinfo>
Oct 25 17:52:53 user nova-compute[74739]:   <os>
Oct 25 17:52:53 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:52:53 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:52:53 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:52:53 user nova-compute[74739]:   </os>
Oct 25 17:52:53 user nova-compute[74739]:   <features>
Oct 25 17:52:53 user nova-compute[74739]:     <acpi/>
Oct 25 17:52:53 user nova-compute[74739]:     <apic/>
Oct 25 17:52:53 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:52:53 user nova-compute[74739]:   </features>
Oct 25 17:52:53 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:52:53 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:52:53 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:52:53 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:52:53 user nova-compute[74739]:   </clock>
Oct 25 17:52:53 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:52:53 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:52:53 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:52:53 user nova-compute[74739]:   </cpu>
Oct 25 17:52:53 user nova-compute[74739]:   <devices>
Oct 25 17:52:53 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:52:53 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:52:53 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk"/>
Oct 25 17:52:53 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:52:53 user nova-compute[74739]:     </disk>
Oct 25 17:52:53 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:52:53 user nova-compute[74739]:       <mac address="fa:16:3e:dd:0e:84"/>
Oct 25 17:52:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:53 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:52:53 user nova-compute[74739]:       <target dev="tap728bb0b9-cf"/>
Oct 25 17:52:53 user nova-compute[74739]:     </interface>
Oct 25 17:52:53 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:52:53 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/console.log" append="off"/>
Oct 25 17:52:53 user nova-compute[74739]:     </serial>
Oct 25 17:52:53 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:52:53 user nova-compute[74739]:     <video>
Oct 25 17:52:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:53 user nova-compute[74739]:     </video>
Oct 25 17:52:53 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:52:53 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:52:53 user nova-compute[74739]:     </rng>
Oct 25 17:52:53 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:52:53 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:52:53 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:52:53 user nova-compute[74739]:     </memballoon>
Oct 25 17:52:53 user nova-compute[74739]:   </devices>
Oct 25 17:52:53 user nova-compute[74739]: </domain>
Oct 25 17:52:53 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850451263',display_name='tempest-VolumesAdminNegativeTest-server-1850451263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850451263',id=16,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIoB4dyasREWrS4wKusYeqm5Qz8Jy+5wPEkzIQdflH1L+u+IWao1RPoHl38CbALMfqLeBDE36AlUkQ2Vj82frRS4TrhChUitrma84DX1cTPnuFp6diNYP8p6uTnvfzWA==',key_name='tempest-keypair-1607306597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-ozo71di3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=02425b58-f6d0-49f6-bb07-b17608560557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG os_vif [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cee9ba88-5a04-52bc-bd54-dc108d379b78', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap728bb0b9-cf, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap728bb0b9-cf, col_values=(('qos', UUID('9933396e-3384-4233-9124-5af2e8740360')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap728bb0b9-cf, col_values=(('external_ids', {'iface-id': '728bb0b9-cfcf-4876-b97b-02109cd837da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:0e:84', 'vm-uuid': '02425b58-f6d0-49f6-bb07-b17608560557'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:53 user nova-compute[74739]: INFO os_vif [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf')
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No VIF found with MAC fa:16:3e:dd:0e:84, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e6e61af2-462b-4c23-a068-00e27c7216b6 req-cb3c4347-1147-446a-8397-752ae683726a service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updated VIF entry in instance network info cache for port 728bb0b9-cfcf-4876-b97b-02109cd837da. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updating instance_info_cache with network_info: [{"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 0 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:52:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6931e81-3393-4a1f-9ec1-e4c7249e1221 req-e98df775-26e4-468d-af78-707659460cda service nova] Releasing lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:52:54 user nova-compute[74739]: INFO nova.compute.claims [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Claim successful on node user
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-d976bd9f-4b53-416c-92e8-4404ffb75ed9. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.network.neutron [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:52:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:52:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.policy [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db9e105e32fb4d5782cc5af8eaa4c06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29d5c35e2c04cb18fa027da2ff93c62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.network.neutron [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:52:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Creating image(s)
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "/opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "/opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "/opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.256s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.243s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk 1073741824" returned: 0 in 0.085s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Successfully created port: b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Cannot resize image /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Ensure instance console log exists: /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ff2f0be8-47e5-4671-a29d-59bfc2480cdd req-c7797895-8c1c-4919-827f-6e5be55915eb service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Successfully updated port: b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquired lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-changed-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Refreshing instance network info cache due to event network-changed-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] Acquiring lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Updating instance_info_cache with network_info: [{"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] No waiting events found dispatching network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:56 user nova-compute[74739]: WARNING nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received unexpected event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da for instance with vm_state building and task_state spawning.
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-d4f6caff-3f68-4d0e-b8ae-0608a5c90420. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Releasing lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Instance network_info: |[{"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] Acquired lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.network.neutron [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Refreshing network info cache for port b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Start _get_guest_xml network_info=[{"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:52:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1755445749',display_name='tempest-ServersNegativeTestJSON-server-1755445749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1755445749',id=17,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-u24d1lpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:55Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=48dc27d9-c7d2-49bd-aecb-dfee636798f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lazy-loading 'pci_devices' on Instance uuid 48dc27d9-c7d2-49bd-aecb-dfee636798f3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.neutron [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:52:57 user nova-compute[74739]:   <uuid>48dc27d9-c7d2-49bd-aecb-dfee636798f3</uuid>
Oct 25 17:52:57 user nova-compute[74739]:   <name>instance-00000011</name>
Oct 25 17:52:57 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:52:57 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:52:57 user nova-compute[74739]:   <metadata>
Oct 25 17:52:57 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:52:57 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:name>tempest-ServersNegativeTestJSON-server-1755445749</nova:name>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:52:57</nova:creationTime>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:52:57 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:52:57 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:owner>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:user uuid="db9e105e32fb4d5782cc5af8eaa4c06b">tempest-ServersNegativeTestJSON-334148990-project-member</nova:user>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:project uuid="e29d5c35e2c04cb18fa027da2ff93c62">tempest-ServersNegativeTestJSON-334148990</nova:project>
Oct 25 17:52:57 user nova-compute[74739]:       </nova:owner>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:52:57 user nova-compute[74739]:       <nova:ports>
Oct 25 17:52:57 user nova-compute[74739]:         <nova:port uuid="b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f">
Oct 25 17:52:57 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 17:52:57 user nova-compute[74739]:         </nova:port>
Oct 25 17:52:57 user nova-compute[74739]:       </nova:ports>
Oct 25 17:52:57 user nova-compute[74739]:     </nova:instance>
Oct 25 17:52:57 user nova-compute[74739]:   </metadata>
Oct 25 17:52:57 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:52:57 user nova-compute[74739]:     <system>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="serial">48dc27d9-c7d2-49bd-aecb-dfee636798f3</entry>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="uuid">48dc27d9-c7d2-49bd-aecb-dfee636798f3</entry>
Oct 25 17:52:57 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:52:57 user nova-compute[74739]:     </system>
Oct 25 17:52:57 user nova-compute[74739]:   </sysinfo>
Oct 25 17:52:57 user nova-compute[74739]:   <os>
Oct 25 17:52:57 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:52:57 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:52:57 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:52:57 user nova-compute[74739]:   </os>
Oct 25 17:52:57 user nova-compute[74739]:   <features>
Oct 25 17:52:57 user nova-compute[74739]:     <acpi/>
Oct 25 17:52:57 user nova-compute[74739]:     <apic/>
Oct 25 17:52:57 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:52:57 user nova-compute[74739]:   </features>
Oct 25 17:52:57 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:52:57 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:52:57 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:52:57 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:52:57 user nova-compute[74739]:   </clock>
Oct 25 17:52:57 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:52:57 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:52:57 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:52:57 user nova-compute[74739]:   </cpu>
Oct 25 17:52:57 user nova-compute[74739]:   <devices>
Oct 25 17:52:57 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:52:57 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:52:57 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk"/>
Oct 25 17:52:57 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:52:57 user nova-compute[74739]:     </disk>
Oct 25 17:52:57 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:52:57 user nova-compute[74739]:       <mac address="fa:16:3e:7b:da:5e"/>
Oct 25 17:52:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:57 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:52:57 user nova-compute[74739]:       <target dev="tapb795f3a6-b9"/>
Oct 25 17:52:57 user nova-compute[74739]:     </interface>
Oct 25 17:52:57 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:52:57 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/console.log" append="off"/>
Oct 25 17:52:57 user nova-compute[74739]:     </serial>
Oct 25 17:52:57 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:52:57 user nova-compute[74739]:     <video>
Oct 25 17:52:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:52:57 user nova-compute[74739]:     </video>
Oct 25 17:52:57 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:52:57 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:52:57 user nova-compute[74739]:     </rng>
Oct 25 17:52:57 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:52:57 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:52:57 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:52:57 user nova-compute[74739]:     </memballoon>
Oct 25 17:52:57 user nova-compute[74739]:   </devices>
Oct 25 17:52:57 user nova-compute[74739]: </domain>
Oct 25 17:52:57 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1755445749',display_name='tempest-ServersNegativeTestJSON-server-1755445749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1755445749',id=17,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-u24d1lpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:55Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=48dc27d9-c7d2-49bd-aecb-dfee636798f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG os_vif [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f941553-36ce-510e-aa0c-6d66abb43a70', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb795f3a6-b9, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb795f3a6-b9, col_values=(('qos', UUID('8d2cb645-485e-47ce-aa6c-058db667654e')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb795f3a6-b9, col_values=(('external_ids', {'iface-id': 'b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:da:5e', 'vm-uuid': '48dc27d9-c7d2-49bd-aecb-dfee636798f3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:57 user nova-compute[74739]: INFO os_vif [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9')
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] No VIF found with MAC fa:16:3e:7b:da:5e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.neutron [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] No waiting events found dispatching network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:57 user nova-compute[74739]: WARNING nova.compute.manager [req-08b6d1b6-37a3-4ac5-a576-e8e5791b7eff req-ca00aef1-0ed5-4eb1-89b2-5b8ac8b9e9b2 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received unexpected event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da for instance with vm_state building and task_state spawning.
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: 4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.neutron [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Updated VIF entry in instance network info cache for port b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.network.neutron [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Updating instance_info_cache with network_info: [{"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3f2768ca-7b49-4397-8913-0e8b63e85ebf req-4e43740a-3397-4997-9eeb-f3b313c297a2 service nova] Releasing lock "refresh_cache-48dc27d9-c7d2-49bd-aecb-dfee636798f3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:52:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Instance spawned successfully.
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:52:57 user nova-compute[74739]: INFO nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Took 7.11 seconds to spawn the instance on the hypervisor.
Oct 25 17:52:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:52:58 user nova-compute[74739]: INFO nova.compute.manager [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Took 8.23 seconds to build instance.
Oct 25 17:52:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c65d719-0148-4fe7-a630-6fd164eed380 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: 4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-4ca4d4ff-6445-44cd-9cfd-7b562de402ac. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port 4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:52:59 user nova-compute[74739]: WARNING nova.compute.manager [req-0c935041-09c5-4222-ae5f-60e420923016 req-d7a5cc33-ac26-4295-92a9-2c1af4ef78bc service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state building and task_state spawning.
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-4105aeeb-1f9d-48bb-8af3-f535cf468fc0. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port 4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:52:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:53:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d56db8f6-d6ed-4725-984c-8ec60f8fe7be req-3ec842a9-dab5-48fe-9693-b3498c6b2b18 service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: 7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:53:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-7a3a58c1-f319-4e81-a0f6-c364de654b0f. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.network.neutron [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port 7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.network.neutron [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:01 user nova-compute[74739]: WARNING nova.compute.manager [req-960d6158-3fb0-4bdc-8ab6-74f403a6d3ac req-37315413-dbe9-45b9-8797-e96f9f096707 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state building and task_state spawning.
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.network.neutron [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b84c1fb0-7ba3-42c1-bc9a-c4ad4979fbff req-b2a6e68e-fa99-46e7-b459-ed0353b0217a service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:53:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Instance spawned successfully.
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:53:01 user nova-compute[74739]: INFO nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Took 6.84 seconds to spawn the instance on the hypervisor.
Oct 25 17:53:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:53:02 user nova-compute[74739]: INFO nova.compute.manager [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Took 7.99 seconds to build instance.
Oct 25 17:53:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6984c72d-3d2a-4fc6-9b32-7677016616f5 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.150s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Successfully updated port: ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:53:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing instance network info cache due to event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated VIF entry in instance network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-ef007ab4-6e9c-4df5-b2b5-df3227795967. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 17:53:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Skipping network cache update for instance because it is Building. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 17:53:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:05 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:53:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance network_info: |[{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing instance network info cache due to event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.network.neutron [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:06 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updated VIF entry in instance network info cache for port ef007ab4-6e9c-4df5-b2b5-df3227795967. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fa523436-b602-4278-87e0-233fd0a13261 req-c3bbf828-20c1-4061-a849-35cd3a3e996c service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated VIF entry in instance network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8edc88ee-ea3e-4ebc-9ced-10579733343a req-3ba12fc9-8f6f-418c-80a8-d277f06adddd service nova] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:12 user nova-compute[74739]: INFO nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Booting with volume b5342404-8ab2-44bc-992c-d72d14d618a7 at /dev/vdb
Oct 25 17:53:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:13 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:13 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.086013793945312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810a159-467b-4de7-8b9c-2586bcf7086b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f3300b-95fe-454f-a158-553c0cec1059]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89d2d81-898b-4233-92d9-1df70b5eaf7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89cf193-56fb-4505-8a78-7f1b198f4f74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:53:13 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:53:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2ed483-7e19-4390-8307-c6fb812e47ed]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating existing volume attachment record: 26d619f2-9f6c-4a31-82bd-3d1a5be669d9 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Applying migration context for instance 7926c5ce-2435-4493-813f-4dca6e1f204f as it has an incoming, in-progress migration 832e3d52-9ab1-4042-bc88-7e39d31810a0. Migration status is finished {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 17:53:13 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating resource usage from migration 832e3d52-9ab1-4042-bc88-7e39d31810a0
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance a8d9aaf2-caff-47c9-9add-1963381511d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Migration 832e3d52-9ab1-4042-bc88-7e39d31810a0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 12e498ae-bfa5-4cfb-b9be-7358e38b736e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 48dc27d9-c7d2-49bd-aecb-dfee636798f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:53:13 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.274s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:14 user nova-compute[74739]: WARNING nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 08290f01-eee3-48ee-b4a0-1d976346f139 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 12e498ae-bfa5-4cfb-b9be-7358e38b736e {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 48dc27d9-c7d2-49bd-aecb-dfee636798f3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3ebb8df7-813e-4118-9689-f56934edf958" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.158s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3ebb8df7-813e-4118-9689-f56934edf958" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.184s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.182s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.194s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:19 user nova-compute[74739]: INFO nova.compute.manager [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Rebooting instance
Oct 25 17:53:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:20 user nova-compute[74739]: WARNING nova.compute.manager [req-b10e2f1c-7b0b-40d4-9844-f289e0e4016f req-f66d2d4e-641b-447e-ba4f-a0d481a4e254 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 17:53:21 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance destroyed successfully.
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.objects.instance [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'resources' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:53:20Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff881ee6-94, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45ce4b79-a8db-4937-98ed-ae323f5ecc8e) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:21 user nova-compute[74739]: INFO os_vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94')
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:21 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddca62-845f-447f-bd50-75a0d1d90b20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:53:21 user nova-compute[74739]: No targets found.
Oct 25 17:53:21 user nova-compute[74739]: iSNS:
Oct 25 17:53:21 user nova-compute[74739]: No targets found.
Oct 25 17:53:21 user nova-compute[74739]: STATIC:
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:53:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:21 user nova-compute[74739]: FIRMWARE:
Oct 25 17:53:21 user nova-compute[74739]: No targets found.
Oct 25 17:53:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:53:21 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:53:21 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1edc56-f024-4fad-8747-2269b9ea62ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b8b2a-f51d-4142-ac01-e6c202b1036d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:21 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec176200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8488ab7d-b740-42ef-a59c-4ccfd7ab18d5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[160bddde-672d-43a7-8ce9-55b2bad58685]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9a030a-1528-4e43-b9bf-216acfb974e3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[86877746-30b2-4f4a-84fe-35d5f16b4a7a]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0295bf9f-ce5f-4925-883e-18a2cfb66d68]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68515224-9842-47ae-a3d7-46d6100d9650]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]
Oct 25 17:53:21 user nova-compute[74739]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.
Oct 25 17:53:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb15b8-ac8f-4de5-9742-b3c173b6d9f3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== disconnect_volume: return (371ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start _get_guest_xml network_info=[{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6dce144c-d2cf-4a7e-996a-497cd0fa6c74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '6dce144c-d2cf-4a7e-996a-497cd0fa6c74'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c36ba378-2585-4f2b-a01f-a9886a4e3c7e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c5efeb2e-f9d5-42bc-a11f-397ab1f35823', 'attached_at': '', 'detached_at': '', 'volume_id': 'ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'serial': 'ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:53:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6dce144c-d2cf-4a7e-996a-497cd0fa6c74,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.objects.instance [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.objects.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Object Instance<c5efeb2e-f9d5-42bc-a11f-397ab1f35823> lazy-loaded attributes: resources,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:21 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:21 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:21 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5b07f-6d9b-459b-9b50-866c13cc8fe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:53:21 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b7866f-a781-4393-a3de-36b997d486e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293] added
Oct 25 17:53:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7312d562-e636-4009-8b94-de4646c7b0ae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39e554-11e2-4b8a-a29b-838753538481]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzhWsRak {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzhWsRak" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1ca09b-05ff-400c-83d5-574ea1c71f65]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzhWsRak'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e052d86f-1a9a-44c0-ae7e-e82889c8ace4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4003a17-bdb6-4bf8-82d5-e7d63f4235b7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c8745c-fbb7-47d7-bbe1-0af25d8a426f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]
Oct 25 17:53:22 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.
Oct 25 17:53:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6116e797-7f45-4248-8bfe-5ac2b1bce8af]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d421811-4635-40d3-aa83-156d7bf2d9f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:22 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cac798-2687-472b-a765-937eadfc4ca7]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:53:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:23 user nova-compute[74739]: WARNING nova.compute.manager [req-f70a7fcc-3433-48b2-b81e-fd0d29460a80 req-516aab00-e932-4129-ba37-fe5c4637cf4c service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 17:53:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23336373238323165', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336373238323165', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:53:20Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'pci_devices' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.objects.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Object Instance<c5efeb2e-f9d5-42bc-a11f-397ab1f35823> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:53:23 user nova-compute[74739]:   <uuid>c5efeb2e-f9d5-42bc-a11f-397ab1f35823</uuid>
Oct 25 17:53:23 user nova-compute[74739]:   <name>instance-0000000c</name>
Oct 25 17:53:23 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:53:23 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:53:23 user nova-compute[74739]:   <metadata>
Oct 25 17:53:23 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:53:23 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:name>tempest-TestMinimumBasicScenario-server-337550697</nova:name>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:53:21</nova:creationTime>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:53:23 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:53:23 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:owner>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:user uuid="6c1ddab8fb434e49b076d09fc47ab457">tempest-TestMinimumBasicScenario-265773077-project-member</nova:user>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:project uuid="ffa01a7434304fa29b2944261e223a3a">tempest-TestMinimumBasicScenario-265773077</nova:project>
Oct 25 17:53:23 user nova-compute[74739]:       </nova:owner>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:root type="image" uuid="6dce144c-d2cf-4a7e-996a-497cd0fa6c74"/>
Oct 25 17:53:23 user nova-compute[74739]:       <nova:ports>
Oct 25 17:53:23 user nova-compute[74739]:         <nova:port uuid="ff881ee6-9485-4a9d-a60f-623bbf5169a1">
Oct 25 17:53:23 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 17:53:23 user nova-compute[74739]:         </nova:port>
Oct 25 17:53:23 user nova-compute[74739]:       </nova:ports>
Oct 25 17:53:23 user nova-compute[74739]:     </nova:instance>
Oct 25 17:53:23 user nova-compute[74739]:   </metadata>
Oct 25 17:53:23 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:53:23 user nova-compute[74739]:     <system>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="serial">c5efeb2e-f9d5-42bc-a11f-397ab1f35823</entry>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="uuid">c5efeb2e-f9d5-42bc-a11f-397ab1f35823</entry>
Oct 25 17:53:23 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:53:23 user nova-compute[74739]:     </system>
Oct 25 17:53:23 user nova-compute[74739]:   </sysinfo>
Oct 25 17:53:23 user nova-compute[74739]:   <os>
Oct 25 17:53:23 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:53:23 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:53:23 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:53:23 user nova-compute[74739]:   </os>
Oct 25 17:53:23 user nova-compute[74739]:   <features>
Oct 25 17:53:23 user nova-compute[74739]:     <acpi/>
Oct 25 17:53:23 user nova-compute[74739]:     <apic/>
Oct 25 17:53:23 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:53:23 user nova-compute[74739]:   </features>
Oct 25 17:53:23 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:53:23 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:53:23 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:53:23 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:53:23 user nova-compute[74739]:   </clock>
Oct 25 17:53:23 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:53:23 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:53:23 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:53:23 user nova-compute[74739]:   </cpu>
Oct 25 17:53:23 user nova-compute[74739]:   <devices>
Oct 25 17:53:23 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:53:23 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:53:23 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk"/>
Oct 25 17:53:23 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:53:23 user nova-compute[74739]:     </disk>
Oct 25 17:53:23 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:53:23 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:53:23 user nova-compute[74739]:       <source dev="/dev/sdd"/>
Oct 25 17:53:23 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 17:53:23 user nova-compute[74739]:       <serial>ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293</serial>
Oct 25 17:53:23 user nova-compute[74739]:     </disk>
Oct 25 17:53:23 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:53:23 user nova-compute[74739]:       <mac address="fa:16:3e:73:f5:2d"/>
Oct 25 17:53:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:53:23 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:53:23 user nova-compute[74739]:       <target dev="tapff881ee6-94"/>
Oct 25 17:53:23 user nova-compute[74739]:     </interface>
Oct 25 17:53:23 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:53:23 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/console.log" append="off"/>
Oct 25 17:53:23 user nova-compute[74739]:     </serial>
Oct 25 17:53:23 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:53:23 user nova-compute[74739]:     <video>
Oct 25 17:53:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:53:23 user nova-compute[74739]:     </video>
Oct 25 17:53:23 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:53:23 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:53:23 user nova-compute[74739]:     </rng>
Oct 25 17:53:23 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:53:23 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:53:23 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:53:23 user nova-compute[74739]:     </memballoon>
Oct 25 17:53:23 user nova-compute[74739]:   </devices>
Oct 25 17:53:23 user nova-compute[74739]: </domain>
Oct 25 17:53:23 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.objects.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Object Instance<c5efeb2e-f9d5-42bc-a11f-397ab1f35823> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:53:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Cannot resize image /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.objects.instance [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'migration_context' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.objects.base [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Object Instance<c5efeb2e-f9d5-42bc-a11f-397ab1f35823> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:53:20Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG os_vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9ba7fe8-46ac-5059-84c7-a78e7afa50e9', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff881ee6-94, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff881ee6-94, col_values=(('qos', UUID('fb9dbbfd-6c87-49cc-bb6e-d3a9c8600bb9')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff881ee6-94, col_values=(('external_ids', {'iface-id': 'ff881ee6-9485-4a9d-a60f-623bbf5169a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:f5:2d', 'vm-uuid': 'c5efeb2e-f9d5-42bc-a11f-397ab1f35823'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:24 user nova-compute[74739]: INFO os_vif [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94')
Oct 25 17:53:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:25 user nova-compute[74739]: WARNING nova.compute.manager [req-c0cf8bb4-7081-4b93-83ab-706f5d3f576b req-03652d8f-b149-4017-b6f2-65ab0a2daae0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 17:53:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:27 user nova-compute[74739]: INFO nova.compute.manager [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Unrescuing
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'flavor' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:27 user nova-compute[74739]: WARNING nova.compute.manager [req-9e2dbcb1-2281-4784-9342-9b049e346888 req-6f6a1d9f-c1d4-4c87-8331-838ba31f4da0 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state active and task_state reboot_started_hard.
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:27 user nova-compute[74739]: WARNING nova.compute.manager [req-dbf8b128-71a6-4cde-80ba-12c542abc1fe req-2b93e904-0d70-45d7-9c80-2c6f0a6528c3 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:53:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:53:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance rebooted successfully.
Oct 25 17:53:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:53:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-17a67fcf-2113-4ccb-bdf9-87742f3c5e11 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.527s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance destroyed successfully.
Oct 25 17:53:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:28 user nova-compute[74739]: INFO nova.compute.manager [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Detaching volume 3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:53:29 user nova-compute[74739]: INFO nova.virt.block_device [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Attempting to driver detach volume 3a3f252a-f91d-4ee4-9158-7232c97b388c from mountpoint /dev/vdb
Oct 25 17:53:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Attempting to detach device vdb from instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:53:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:53:29 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:53:29 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:53:29 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:53:29 user nova-compute[74739]:   <serial>3a3f252a-f91d-4ee4-9158-7232c97b388c</serial>
Oct 25 17:53:29 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:53:29 user nova-compute[74739]: </disk>
Oct 25 17:53:29 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:53:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Successfully detached device vdb from instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 from the persistent domain config.
Oct 25 17:53:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:53:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:53:29 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:53:29 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:53:29 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:53:29 user nova-compute[74739]:   <serial>3a3f252a-f91d-4ee4-9158-7232c97b388c</serial>
Oct 25 17:53:29 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:53:29 user nova-compute[74739]: </disk>
Oct 25 17:53:29 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:53:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:53:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:30 user nova-compute[74739]: WARNING nova.compute.manager [req-4919a716-b371-46b3-8ee4-b222f1f719d8 req-0449de8c-e2ae-4f2a-8d89-641e106c0ba4 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing instance network info cache due to event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updated VIF entry in instance network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing instance network info cache due to event network-changed-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Acquiring lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Acquired lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Refreshing network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:53:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updated VIF entry in instance network info cache for port d7f62b72-2e75-4ead-a8be-5657f0d6b8a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:53:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [{"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6dbc96dc-d1d2-4abc-8b6a-b791f9804987 req-16eed17c-d0d2-4a25-8a1f-cec38eb15e37 service nova] Releasing lock "refresh_cache-cb37a637-7bf4-449d-b291-6986eea005e9" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:32 user nova-compute[74739]: WARNING nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:53:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:32 user nova-compute[74739]: WARNING nova.compute.manager [req-e5813213-b263-44cc-bd53-1442b286d9fa req-fdc17682-3d9a-42d4-ae40-2060cae9e0f7 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:53:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e9b0a536-034e-4718-acc7-fa68cca4ac41 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:53:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:35 user nova-compute[74739]: INFO nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Booting with volume d20dfb55-20be-42b9-90ed-12e7a5d82caf at /dev/vdc
Oct 25 17:53:35 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d35b8a-0ef4-45ea-8f65-d7b9511ca01f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdebf43-eb49-47aa-810a-fe08dfe6ec94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1946d5b-95b2-4e87-934e-e205fc2d77fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43be37-f4b8-41e1-bb7e-12f31cef600b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:53:36 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:53:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b8d8a6-74bf-48fd-9461-5def5f34bf77]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG os_brick.utils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:36 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating existing volume attachment record: 1e6a9027-f664-486b-b228-1e16c6a4948f {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:53:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 is timed out.
Oct 25 17:53:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Successfully detached device vdb from instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 from the live domain config.
Oct 25 17:53:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OoPqufsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:49 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14d4e2-fcfb-4a2f-b069-48f4d1dd3535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:53:49 user nova-compute[74739]: No targets found.
Oct 25 17:53:49 user nova-compute[74739]: iSNS:
Oct 25 17:53:49 user nova-compute[74739]: No targets found.
Oct 25 17:53:49 user nova-compute[74739]: STATIC:
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c
Oct 25 17:53:49 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:53:49 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:53:49 user nova-compute[74739]: FIRMWARE:
Oct 25 17:53:49 user nova-compute[74739]: No targets found.
Oct 25 17:53:49 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:53:49 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:53:49 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc43c2da-2356-4b50-bdde-0f148b71f662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8aeb5-f007-4db9-8789-db954a5207f8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:49 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:49 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:49 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc32ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4697a7-6755-427a-8775-910022ccd2b1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5747a-9d77-430a-957d-3e13e1267364]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[98419a1a-d216-4a73-b269-30dc3bbce276]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3265226-c558-4060-9f3b-d2e9ef6698e6]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b59874-52a6-48f6-b560-c25c1b1d0326]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d438931b-6472-48a2-a84c-3679a94aafc3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260]
Oct 25 17:53:50 user nova-compute[74739]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c, portal: 172.16.0.220,3260] successful.
Oct 25 17:53:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a3f252a-f91d-4ee4-9158-7232c97b388c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71c5337-eda3-4511-ba6b-9ab46f7b6ea3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] <== disconnect_volume: return (364ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lazy-loading 'flavor' on Instance uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ea3092f-c8ad-4d04-8b9a-39a1e2dc3088 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.016s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Port 1a7792b1-73e4-43a3-b106-01d131c00444 binding to destination host user is already ACTIVE {{(pid=74739) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:53:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Creating image(s)
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Ensure instance console log exists: /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Start _get_guest_xml network_info=[{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '5bd92763-bd91-4b97-83e6-7edf2bee447d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwpPqAbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12e498ae-bfa5-4cfb-b9be-7358e38b736e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd70c0f25-9b74-4984-a309-c8ddffeae443', 'serial': 'd70c0f25-9b74-4984-a309-c8ddffeae443'}, 'boot_index': 0, 'volume_type': None}, {'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '26d619f2-9f6c-4a31-82bd-3d1a5be669d9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQZslEnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12e498ae-bfa5-4cfb-b9be-7358e38b736e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5342404-8ab2-44bc-992c-d72d14d618a7', 'serial': 'b5342404-8ab2-44bc-992c-d72d14d618a7'}, 'boot_index': 1, 'volume_type': None}, {'mount_device': '/dev/vdc', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '1e6a9027-f664-486b-b228-1e16c6a4948f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmvNZMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12e498ae-bfa5-4cfb-b9be-7358e38b736e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd20dfb55-20be-42b9-90ed-12e7a5d82caf', 'serial': 'd20dfb55-20be-42b9-90ed-12e7a5d82caf'}, 'boot_index': 2, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:53:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwpPqAbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:57 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:57 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:57 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab1b85-628c-4cac-ac9e-b5af759cc5fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:53:57 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26c8c44-14ee-4de8-9b1b-76a7562cbf11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443] added
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ad588-3d9f-49c8-be6a-86b23b2d3b72]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b756ecbb-3527-48ba-a77a-b19c107dfa47]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwpPqAbm {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwpPqAbm" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6f12ea-be43-4ab0-b238-8b1986cec9f7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwpPqAbm'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8239c6-c3a6-491e-950f-d54dfa0455f8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7a5cef-a924-408e-91e9-280b2966aa09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c31c427-c152-4703-bd49-bd20141cff9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260]
Oct 25 17:53:57 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260] successful.
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8760dfa-bbe5-4891-92c4-1b341e1783bb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6871efe0-857d-466a-83f8-8c5b00c3ff4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:57 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[98db9da6-2f82-410c-9fb0-8a570b980a78]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwpPqAbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Creating tmpfile /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f/tmps5u_e2xe to verify with other compute node that the instance is on the same shared storage. {{(pid=74739) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:53:58 user nova-compute[74739]: WARNING nova.compute.manager [req-dc99931f-a0c1-4b7e-ac86-26fda04f26cc req-7d18c4e7-c3d5-4d0e-b847-0b9116fcbb02 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-unplugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state resized and task_state resize_reverting.
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23232346539633963', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232346539633963', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:53:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance destroyed successfully.
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'resources' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_vif [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a7792b1-73, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQZslEnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:58 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.005s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:58 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:53:58 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2561b958-fc43-4f25-95f9-e6f06ebe328d) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:58 user nova-compute[74739]: INFO os_vif [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73')
Oct 25 17:53:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:53:58 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c673dad4-1e25-4ef6-bbd8-9a876204616e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:53:58 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[534a01b0-b02c-47e4-8b0e-b165e70bc0cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7] added
Oct 25 17:53:58 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.076s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ed6410-9c87-4b13-a51b-ed2049cfc4a2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d59650-b0d9-4427-a3e6-1e43177acbc9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQZslEnd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iQZslEnd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[738055a6-c7db-49a0-aad3-d2373ab4d67b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iQZslEnd'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdc35c6-59fc-45ca-80d1-d2e740c28d44]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b94c2-c753-422b-a653-943f2429cb93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:58 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:58 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:58 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b707edc-58f3-4c27-b7a3-e31bbde9562d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260]
Oct 25 17:53:58 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260] successful.
Oct 25 17:53:58 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:58 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a9da47-745d-44d3-a8b7-5eccc062bd93]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a59f16e-6006-422b-80bd-722fd39b6956]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:53:59 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:53:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d2484-27ea-4517-8697-d0553103b79a]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQZslEnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.compute.claims [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Claim successful on node user
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.compute.manager [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Detaching volume 69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.virt.block_device [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Attempting to driver detach volume 69cb53dc-79b3-4e10-ae03-93c970cc8770 from mountpoint /dev/vdc
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Attempting to detach device vdc from instance a8d9aaf2-caff-47c9-9add-1963381511d5 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:53:59 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:53:59 user nova-compute[74739]:   <source dev="/dev/sdg"/>
Oct 25 17:53:59 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 17:53:59 user nova-compute[74739]:   <serial>69cb53dc-79b3-4e10-ae03-93c970cc8770</serial>
Oct 25 17:53:59 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 17:53:59 user nova-compute[74739]: </disk>
Oct 25 17:53:59 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully detached device vdc from instance a8d9aaf2-caff-47c9-9add-1963381511d5 from the persistent domain config.
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a8d9aaf2-caff-47c9-9add-1963381511d5 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:53:59 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:53:59 user nova-compute[74739]:   <source dev="/dev/sdg"/>
Oct 25 17:53:59 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 17:53:59 user nova-compute[74739]:   <serial>69cb53dc-79b3-4e10-ae03-93c970cc8770</serial>
Oct 25 17:53:59 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 17:53:59 user nova-compute[74739]: </disk>
Oct 25 17:53:59 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.policy [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f9c0d42d1a402c8c17d32a328dd67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d58fc42ec534beb8c2e756b6f7edc3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:53:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Creating image(s)
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "/opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "/opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:53:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26132303636313038', 'path': '/dev/sdh'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132303636313038', 'path': '/dev/sdh'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.427s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f4ec38-3e00-4236-86bd-43bf966b8004]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:54:00 user nova-compute[74739]: No targets found.
Oct 25 17:54:00 user nova-compute[74739]: iSNS:
Oct 25 17:54:00 user nova-compute[74739]: No targets found.
Oct 25 17:54:00 user nova-compute[74739]: STATIC:
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:54:00 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:00 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:00 user nova-compute[74739]: FIRMWARE:
Oct 25 17:54:00 user nova-compute[74739]: No targets found.
Oct 25 17:54:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:54:00 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:54:00 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[319a537a-1f8d-496f-aab6-737aaf6ef993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmvNZMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:54:00 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:54:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] No waiting events found dispatching network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:01 user nova-compute[74739]: WARNING nova.compute.manager [req-a50bfef6-2348-48a1-8c44-c748537fe00e req-1219f105-37b0-4b17-b84e-f848a9396018 service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received unexpected event network-vif-plugged-1a7792b1-73e4-43a3-b106-01d131c00444 for instance with vm_state resized and task_state resize_reverting.
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33f781-b0df-407f-885c-7cba55e96487]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec409d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a'): ({'sdf'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Removing single pathed devices sdf {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6555e5-a8f3-4c7d-bb6c-0b4285e2822b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c319e38-e9fa-42d9-aa9d-6eb8788d100f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Flushing IO for device /dev/sdf {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c936ac2-516e-4afc-aa37-6f30c6df0fc2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk 1073741824" returned: 0 in 0.055s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.078s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea5109-c150-48b5-b1ae-0a406c4fedf0]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.128s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7558e-9b25-482e-926f-3c033b628c30]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.259s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e531103-69d0-44f1-a175-60aa5871b5a9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260]
Oct 25 17:54:01 user nova-compute[74739]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a, portal: 172.16.0.220,3260] successful.
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Cannot resize image /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Ensure instance console log exists: /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.160s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4c3ba8-1fd1-4d5e-83bb-f6219f18f444]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.748s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== disconnect_volume: return (2174ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.670s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:54:01 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.012s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:54:01 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac031a1f-81a9-4ca7-b58d-8cbaf87f6f11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:54:01 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b326ab53-29d2-43d1-b1ee-0cac255e3662]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf] added
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94d168-8e62-4c76-ae6c-7a0567de4291]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad014c06-5960-48e7-9655-4c0bd4d8ce5d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmvNZMR {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBmvNZMR" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae60a2a-b2b4-4f97-976e-a728d4c40a28]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBmvNZMR'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Successfully created port: 894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a7a56b-4f69-42a1-bc5f-34e6fb1d7645]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69556dbf-317e-4fd2-b2fc-cc44153c0b17]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: INFO nova.compute.manager [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Detaching volume 1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[17da407b-04c5-440c-9389-85a71fb88805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260]
Oct 25 17:54:01 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260] successful.
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: INFO nova.virt.block_device [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Attempting to driver detach volume 1be5522d-af74-404d-bf6b-60f854ada82b from mountpoint /dev/vdb
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Attempting to detach device vdb from instance cb37a637-7bf4-449d-b291-6986eea005e9 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:54:01 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:54:01 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:54:01 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:54:01 user nova-compute[74739]:   <serial>1be5522d-af74-404d-bf6b-60f854ada82b</serial>
Oct 25 17:54:01 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:54:01 user nova-compute[74739]: </disk>
Oct 25 17:54:01 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b02e5f-3de6-4848-80da-177511155bbf]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Successfully detached device vdb from instance cb37a637-7bf4-449d-b291-6986eea005e9 from the persistent domain config.
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb37a637-7bf4-449d-b291-6986eea005e9 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:54:01 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:54:01 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:54:01 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:54:01 user nova-compute[74739]:   <serial>1be5522d-af74-404d-bf6b-60f854ada82b</serial>
Oct 25 17:54:01 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:54:01 user nova-compute[74739]: </disk>
Oct 25 17:54:01 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8088a6cf-da0d-42bf-9f90-f89f9226a388]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:01 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5bd82-e0aa-4318-9450-fac34e612167]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Successfully updated port: 894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquired lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-changed-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Refreshing instance network info cache due to event network-changed-894c2384-bea3-4cff-9111-d76b6c77de4e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] Acquiring lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'migration_context' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:01 user nova-compute[74739]: DEBUG nova.objects.base [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Object Instance<7926c5ce-2435-4493-813f-4dca6e1f204f> lazy-loaded attributes: resources,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updating instance_info_cache with network_info: [{"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Releasing lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Instance network_info: |[{"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] Acquired lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Refreshing network info cache for port 894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Start _get_guest_xml network_info=[{"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:54:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1896820324',display_name='tempest-VolumesSnapshotTestJSON-instance-1896820324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1896820324',id=18,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRpee8cgyjGJcx1/YTIkADRoVpRFrpTuQzbnR8R2mJqD/t6U3/pt+CEcAzQqOo2PopdHr5qNE2VuJ32Dzy2gQA0ERVJ7ms/Y7sxZqRxaEOkX8esVM41bhwvBgAub7dyVg==',key_name='tempest-keypair-251855502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-o62e5dj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=4ea9932d-a6ac-4e0b-84fb-c3feab248ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmvNZMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== connect_volume: return (2117ms) {'type': 'block', 'scsi_wwn': '23665653839373631', 'path': '/dev/sdf'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665653839373631', 'path': '/dev/sdf'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:54:02 user nova-compute[74739]:   <uuid>4ea9932d-a6ac-4e0b-84fb-c3feab248ed1</uuid>
Oct 25 17:54:02 user nova-compute[74739]:   <name>instance-00000012</name>
Oct 25 17:54:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:54:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:54:02 user nova-compute[74739]:   <metadata>
Oct 25 17:54:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:54:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1896820324</nova:name>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:54:02</nova:creationTime>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:54:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:owner>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:user uuid="b9f9c0d42d1a402c8c17d32a328dd67f">tempest-VolumesSnapshotTestJSON-1623722059-project-member</nova:user>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:project uuid="2d58fc42ec534beb8c2e756b6f7edc3d">tempest-VolumesSnapshotTestJSON-1623722059</nova:project>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:owner>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:ports>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="894c2384-bea3-4cff-9111-d76b6c77de4e">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:ports>
Oct 25 17:54:02 user nova-compute[74739]:     </nova:instance>
Oct 25 17:54:02 user nova-compute[74739]:   </metadata>
Oct 25 17:54:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:54:02 user nova-compute[74739]:     <system>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="serial">4ea9932d-a6ac-4e0b-84fb-c3feab248ed1</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="uuid">4ea9932d-a6ac-4e0b-84fb-c3feab248ed1</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:54:02 user nova-compute[74739]:     </system>
Oct 25 17:54:02 user nova-compute[74739]:   </sysinfo>
Oct 25 17:54:02 user nova-compute[74739]:   <os>
Oct 25 17:54:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:54:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:54:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:54:02 user nova-compute[74739]:   </os>
Oct 25 17:54:02 user nova-compute[74739]:   <features>
Oct 25 17:54:02 user nova-compute[74739]:     <acpi/>
Oct 25 17:54:02 user nova-compute[74739]:     <apic/>
Oct 25 17:54:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:54:02 user nova-compute[74739]:   </features>
Oct 25 17:54:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:54:02 user nova-compute[74739]:   </clock>
Oct 25 17:54:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:54:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:54:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:54:02 user nova-compute[74739]:   </cpu>
Oct 25 17:54:02 user nova-compute[74739]:   <devices>
Oct 25 17:54:02 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:54:02 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:54:02 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:     </disk>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:5b:f5:db"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tap894c2384-be"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:54:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/console.log" append="off"/>
Oct 25 17:54:02 user nova-compute[74739]:     </serial>
Oct 25 17:54:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:54:02 user nova-compute[74739]:     <video>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:     </video>
Oct 25 17:54:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:54:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:54:02 user nova-compute[74739]:     </rng>
Oct 25 17:54:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:54:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:54:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:54:02 user nova-compute[74739]:     </memballoon>
Oct 25 17:54:02 user nova-compute[74739]:   </devices>
Oct 25 17:54:02 user nova-compute[74739]: </domain>
Oct 25 17:54:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1896820324',display_name='tempest-VolumesSnapshotTestJSON-instance-1896820324',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1896820324',id=18,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRpee8cgyjGJcx1/YTIkADRoVpRFrpTuQzbnR8R2mJqD/t6U3/pt+CEcAzQqOo2PopdHr5qNE2VuJ32Dzy2gQA0ERVJ7ms/Y7sxZqRxaEOkX8esVM41bhwvBgAub7dyVg==',key_name='tempest-keypair-251855502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-o62e5dj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=4ea9932d-a6ac-4e0b-84fb-c3feab248ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28481450-0a24-5d3b-9cc9-7dbd5bb79d19', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap894c2384-be, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap894c2384-be, col_values=(('qos', UUID('a3c86b33-3967-473f-b6d9-16999475d42d')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap894c2384-be, col_values=(('external_ids', {'iface-id': '894c2384-bea3-4cff-9111-d76b6c77de4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:f5:db', 'vm-uuid': '4ea9932d-a6ac-4e0b-84fb-c3feab248ed1'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lazy-loading 'pci_devices' on Instance uuid 12e498ae-bfa5-4cfb-b9be-7358e38b736e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:54:02 user nova-compute[74739]:   <uuid>12e498ae-bfa5-4cfb-b9be-7358e38b736e</uuid>
Oct 25 17:54:02 user nova-compute[74739]:   <name>instance-0000000f</name>
Oct 25 17:54:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:54:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:54:02 user nova-compute[74739]:   <metadata>
Oct 25 17:54:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:54:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:name>tempest-device-tagging-server-2096524215</nova:name>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:53:57</nova:creationTime>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:54:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:owner>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:user uuid="aa6bda843240427eb6f7f95a38718afb">tempest-TaggedBootDevicesTest-1402920458-project-member</nova:user>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:project uuid="8c7dc105cff340a4810f5d05bceac2b4">tempest-TaggedBootDevicesTest-1402920458</nova:project>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:owner>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:54:02 user nova-compute[74739]:       <nova:ports>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="d976bd9f-4b53-416c-92e8-4404ffb75ed9">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.1.1.217" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="d4f6caff-3f68-4d0e-b8ae-0608a5c90420">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="4ca4d4ff-6445-44cd-9cfd-7b562de402ac">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="4105aeeb-1f9d-48bb-8af3-f535cf468fc0">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="7a3a58c1-f319-4e81-a0f6-c364de654b0f">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:         <nova:port uuid="ef007ab4-6e9c-4df5-b2b5-df3227795967">
Oct 25 17:54:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 25 17:54:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:02 user nova-compute[74739]:       </nova:ports>
Oct 25 17:54:02 user nova-compute[74739]:     </nova:instance>
Oct 25 17:54:02 user nova-compute[74739]:   </metadata>
Oct 25 17:54:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:54:02 user nova-compute[74739]:     <system>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="serial">12e498ae-bfa5-4cfb-b9be-7358e38b736e</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="uuid">12e498ae-bfa5-4cfb-b9be-7358e38b736e</entry>
Oct 25 17:54:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:54:02 user nova-compute[74739]:     </system>
Oct 25 17:54:02 user nova-compute[74739]:   </sysinfo>
Oct 25 17:54:02 user nova-compute[74739]:   <os>
Oct 25 17:54:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:54:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:54:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:54:02 user nova-compute[74739]:   </os>
Oct 25 17:54:02 user nova-compute[74739]:   <features>
Oct 25 17:54:02 user nova-compute[74739]:     <acpi/>
Oct 25 17:54:02 user nova-compute[74739]:     <apic/>
Oct 25 17:54:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:54:02 user nova-compute[74739]:   </features>
Oct 25 17:54:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:54:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:54:02 user nova-compute[74739]:   </clock>
Oct 25 17:54:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:54:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:54:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:54:02 user nova-compute[74739]:   </cpu>
Oct 25 17:54:02 user nova-compute[74739]:   <devices>
Oct 25 17:54:02 user nova-compute[74739]:     <disk type="file" device="cdrom">
Oct 25 17:54:02 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 17:54:02 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/disk.config"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="hda" bus="ide"/>
Oct 25 17:54:02 user nova-compute[74739]:     </disk>
Oct 25 17:54:02 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:54:02 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:54:02 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <serial>d70c0f25-9b74-4984-a309-c8ddffeae443</serial>
Oct 25 17:54:02 user nova-compute[74739]:     </disk>
Oct 25 17:54:02 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:54:02 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:54:02 user nova-compute[74739]:       <source dev="/dev/sdh"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <serial>b5342404-8ab2-44bc-992c-d72d14d618a7</serial>
Oct 25 17:54:02 user nova-compute[74739]:     </disk>
Oct 25 17:54:02 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:54:02 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:54:02 user nova-compute[74739]:       <source dev="/dev/sdf"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="vdc" bus="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <serial>d20dfb55-20be-42b9-90ed-12e7a5d82caf</serial>
Oct 25 17:54:02 user nova-compute[74739]:     </disk>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:7b:9e:cd"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tap5e0e7612-16"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:c0:cc:08"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tapd976bd9f-4b"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:ed:05:ab"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tapd4f6caff-3f"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:fc:f3:3a"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tap4ca4d4ff-64"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:c6:1e:7a"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tap4105aeeb-1f"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:90:0c:ba"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tap7a3a58c1-f3"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:02 user nova-compute[74739]:       <mac address="fa:16:3e:ac:75:c9"/>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:02 user nova-compute[74739]:       <target dev="tapef007ab4-6e"/>
Oct 25 17:54:02 user nova-compute[74739]:     </interface>
Oct 25 17:54:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:54:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/console.log" append="off"/>
Oct 25 17:54:02 user nova-compute[74739]:     </serial>
Oct 25 17:54:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:54:02 user nova-compute[74739]:     <video>
Oct 25 17:54:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:02 user nova-compute[74739]:     </video>
Oct 25 17:54:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:54:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:54:02 user nova-compute[74739]:     </rng>
Oct 25 17:54:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:54:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:54:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:54:02 user nova-compute[74739]:     </memballoon>
Oct 25 17:54:02 user nova-compute[74739]:   </devices>
Oct 25 17:54:02 user nova-compute[74739]: </domain>
Oct 25 17:54:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03b7e043-09b2-57ec-b4d8-b992863eec3a', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e0e7612-16, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e0e7612-16, col_values=(('qos', UUID('86c760ab-08b5-4a02-b504-efb5a0024bc5')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e0e7612-16, col_values=(('external_ids', {'iface-id': '5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:9e:cd', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ade945b7-9601-5cf0-87c9-df863711e12f', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd976bd9f-4b, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd976bd9f-4b, col_values=(('qos', UUID('0e822287-629f-40e4-85a4-7e1950b7eb27')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd976bd9f-4b, col_values=(('external_ids', {'iface-id': 'd976bd9f-4b53-416c-92e8-4404ffb75ed9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:cc:08', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No VIF found with MAC fa:16:3e:5b:f5:db, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0293f57-4856-5fdc-99ae-5d238d2f5b16', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.605s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f6caff-3f, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4f6caff-3f, col_values=(('qos', UUID('c08ef613-81fe-4b7a-8e60-0b6722f24637')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4f6caff-3f, col_values=(('external_ids', {'iface-id': 'd4f6caff-3f68-4d0e-b8ae-0608a5c90420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:05:ab', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd0ded57-1e34-5ada-a380-48ed42c518c7', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ca4d4ff-64, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ca4d4ff-64, col_values=(('qos', UUID('6df7b3a6-5156-4185-b67a-4ba7c1874013')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ca4d4ff-64, col_values=(('external_ids', {'iface-id': '4ca4d4ff-6445-44cd-9cfd-7b562de402ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:f3:3a', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updated VIF entry in instance network info cache for port 894c2384-bea3-4cff-9111-d76b6c77de4e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updating instance_info_cache with network_info: [{"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc9c6819-01c6-45eb-bc6a-c78cfc66a762 req-9928f429-2738-4b8a-89c2-5595c83b87a1 service nova] Releasing lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '305d6394-2bee-580c-b420-13738f2c32da', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: INFO nova.compute.manager [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Swapping old allocation on dict_keys(['3998dc2a-c940-46be-8c01-65f11782a00e']) held by migration 832e3d52-9ab1-4042-bc88-7e39d31810a0 for instance
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Overwriting current allocation {'allocations': {'3998dc2a-c940-46be-8c01-65f11782a00e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '8d1d84fb43034e9d9f6cf85063763000', 'user_id': '4ace8d9977bb4a0f869bec3b8e79e2cd', 'consumer_generation': 1} on consumer 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4105aeeb-1f, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4105aeeb-1f, col_values=(('qos', UUID('2dad047b-80ee-4099-9201-6df522301cf8')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4105aeeb-1f, col_values=(('external_ids', {'iface-id': '4105aeeb-1f9d-48bb-8af3-f535cf468fc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:1e:7a', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:02 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f')
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6e9c6d7-c9b6-5be3-8acd-a50b40ab4a1d', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a3a58c1-f3, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a3a58c1-f3, col_values=(('qos', UUID('ebd828c8-0dd5-4ae9-8c7f-b8e3468ce31d')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a3a58c1-f3, col_values=(('external_ids', {'iface-id': '7a3a58c1-f319-4e81-a0f6-c364de654b0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:0c:ba', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3')
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b279a5d6-05bb-5c59-9379-3c1c907edf25', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef007ab4-6e, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef007ab4-6e, col_values=(('qos', UUID('5012c63f-01ab-480a-b5dd-e81237fffb8d')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef007ab4-6e, col_values=(('external_ids', {'iface-id': 'ef007ab4-6e9c-4df5-b2b5-df3227795967', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:75:c9', 'vm-uuid': '12e498ae-bfa5-4cfb-b9be-7358e38b736e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: INFO os_vif [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e')
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] No BDM found with device name hda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] No VIF found with MAC fa:16:3e:7b:9e:cd, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] No VIF found with MAC fa:16:3e:c6:1e:7a, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:54:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Using config drive
Oct 25 17:54:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Creating config drive at /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/disk.config
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuyqigfi5 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.utils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be97c521-e841-4adf-b186-3f84787a5ddf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuyqigfi5" returned: 0 in 0.073s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabf1fc-a9ab-405f-b06c-721a7d659fb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617a493-76e7-4bdd-96b5-700a09bba583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca9722-9fb5-445f-91a5-b8b62e6baeb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:54:03 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:54:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddabd62-0c68-4328-b63c-54cbcf1f8e0a]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG os_brick.utils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] No waiting events found dispatching network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:04 user nova-compute[74739]: WARNING nova.compute.manager [req-b639ef36-0419-48a1-8274-6fc97a232983 req-10afb8e7-bd90-4339-975b-9713a6b37876 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received unexpected event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e for instance with vm_state building and task_state spawning.
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:06 user nova-compute[74739]: WARNING nova.compute.manager [req-8d41fe7a-2ceb-497b-bd40-623e535f9e69 req-513b20af-fc56-4612-ad5b-f2b260314fdc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d for instance with vm_state building and task_state spawning.
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: INFO nova.compute.manager [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Unrescuing
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] No waiting events found dispatching network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:06 user nova-compute[74739]: WARNING nova.compute.manager [req-e2d17fa4-07e4-4060-b101-99d453200a9f req-aad3457b-22fa-4938-b45e-822b3e4a6bfb service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received unexpected event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e for instance with vm_state building and task_state spawning.
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'flavor' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Instance spawned successfully.
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:07 user nova-compute[74739]: INFO nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Took 7.94 seconds to spawn the instance on the hypervisor.
Oct 25 17:54:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:07 user nova-compute[74739]: INFO nova.compute.manager [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Took 8.82 seconds to build instance.
Oct 25 17:54:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ad0926c-93c4-4580-8a72-27fa40a8fc51 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.955s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance destroyed successfully.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-478079e0-8098-4e3f-b3c1-4ea808c45a9d req-9df62c06-5d49-4d37-91a0-b34bdd447f22 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [{"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-a8d9aaf2-caff-47c9-9add-1963381511d5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:08 user nova-compute[74739]: WARNING nova.compute.manager [req-0afb0c84-56e2-45da-ab6a-526eec9b5a9b req-64e9bc78-2999-4bc1-bf30-e501a6744b4b service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 for instance with vm_state building and task_state spawning.
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:10 user nova-compute[74739]: WARNING nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f for instance with vm_state building and task_state spawning.
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:10 user nova-compute[74739]: WARNING nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f for instance with vm_state building and task_state spawning.
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:10 user nova-compute[74739]: WARNING nova.compute.manager [req-83107937-aa21-40c1-8717-fde33d760b34 req-f00601d3-1f21-45d2-bd76-64f5de1a2ef9 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:10 user nova-compute[74739]: WARNING nova.compute.manager [req-30b04655-508c-4377-9b1c-560367805070 req-8b6c3f4a-9ec2-4643-8c1d-28ae5582454e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 for instance with vm_state building and task_state spawning.
Oct 25 17:54:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:10 user nova-compute[74739]: WARNING nova.compute.manager [req-6f322003-3180-42bc-9fd4-8019669400b0 req-45477628-57a8-406b-b6ea-c7728593bc8d service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 for instance with vm_state building and task_state spawning.
Oct 25 17:54:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:54:11 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance spawned successfully.
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:11 user nova-compute[74739]: INFO nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Took 14.60 seconds to spawn the instance on the hypervisor.
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:54:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:11 user nova-compute[74739]: INFO nova.compute.manager [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Took 86.31 seconds to build instance.
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bf6066fc-76a7-43ef-aa69-7d1e839ced3a tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 86.815s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-0a0a930f-0c54-4b1b-939d-653b6b9ac883 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json" returned: 0 in 0.477s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 57.503s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:12 user nova-compute[74739]: INFO nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:12 user nova-compute[74739]: WARNING nova.compute.manager [req-29d0f6b7-fa9c-492b-8675-0b32f188a752 req-0ab6dad6-ba74-47d0-bb22-3e384f128fa7 service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state rescued and task_state unrescuing.
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:12 user nova-compute[74739]: WARNING nova.compute.manager [req-265367c1-4f65-412a-b91f-64de2709997c req-c6217c0d-debb-42c4-9d94-c39a4d1587bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 for instance with vm_state active and task_state None.
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:54:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8/disk --force-share --output=json" returned: 0 in 0.505s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7462MB free_disk=25.006927490234375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance cb37a637-7bf4-449d-b291-6986eea005e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance a8d9aaf2-caff-47c9-9add-1963381511d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 12e498ae-bfa5-4cfb-b9be-7358e38b736e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 48dc27d9-c7d2-49bd-aecb-dfee636798f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b29f69fa-c815-494c-80ca-fa26973a55c4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:54:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.483s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:54:17 user nova-compute[74739]: INFO nova.compute.claims [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Claim successful on node user
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:54:17 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:54:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.policy [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f1fa0911cff4b7fbbb4ba5096ef7969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e07a2c34ca0f4b5c9ef15cc25c341952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:54:18 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Creating image(s)
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "/opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "/opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "/opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.238s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk 1073741824" returned: 0 in 0.057s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Successfully created port: d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.220s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:54:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Cannot resize image /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Ensure instance console log exists: /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:19 user nova-compute[74739]: INFO nova.compute.manager [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Terminating instance
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Successfully updated port: d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquired lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-changed-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Refreshing instance network info cache due to event network-changed-d824bc69-2605-4d52-a156-abae100ada96. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] Acquiring lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:54:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a8d9aaf2-caff-47c9-9add-1963381511d5 is timed out.
Oct 25 17:54:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully detached device vdc from instance a8d9aaf2-caff-47c9-9add-1963381511d5 from the live domain config.
Oct 25 17:54:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uqtoknAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:54:19 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d032df-b784-4301-8148-1438805f5132]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:54:19 user nova-compute[74739]: No targets found.
Oct 25 17:54:19 user nova-compute[74739]: iSNS:
Oct 25 17:54:19 user nova-compute[74739]: No targets found.
Oct 25 17:54:19 user nova-compute[74739]: STATIC:
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:54:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:19 user nova-compute[74739]: FIRMWARE:
Oct 25 17:54:19 user nova-compute[74739]: No targets found.
Oct 25 17:54:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:54:19 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:54:19 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:54:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a113817-b1fe-47bf-a761-52a2120a84db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d176c6-3bb4-4e4e-881b-5b3fb129561a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:20 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc23e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770'): ({'sdg'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Removing single pathed devices sdg {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e77ec9-624e-4249-96f0-3fa5e9a4d27c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b52a0d1-dc99-4249-853e-53711c7de224]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flushing IO for device /dev/sdg {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42f965-0444-4df1-8fe0-715a9cf957ad]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[43936782-3d28-4303-b89b-b4d928ae89c8]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] SCSI volumes sdg have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d1bd15-b89b-4ef6-854e-66d86e33a9af]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Instance destroyed successfully.
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lazy-loading 'resources' on Instance uuid 59ca18ab-9b5c-4738-b9f6-955dc6e48be8 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1365366211',display_name='tempest-TestVolumeSwap-server-1365366211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1365366211',id=8,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAJAnGApQm/OC/hbNe6UG5388QzNEwG5pxaKUOq87m06/j2ZMZEovNKn29ebu/SfDmpYyLdj07Wi0n46lo0FdLTcfjlWxaOwNsm6F1Zoz1LavpVCe5VOYa0PxPchSPLIQ==',key_name='tempest-keypair-2064246814',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d81620669f1439d97ca2ab8bec75077',ramdisk_id='',reservation_id='r-2awhfpa9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1896463606',owner_user_name='tempest-TestVolumeSwap-1896463606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f7c0167f56645938072e7ec7a79538f',uuid=59ca18ab-9b5c-4738-b9f6-955dc6e48be8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converting VIF {"id": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "address": "fa:16:3e:6e:2f:94", "network": {"id": "67c6c28e-fe62-46f0-9b3e-086039c5202b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1082925667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d81620669f1439d97ca2ab8bec75077", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ef64567-0d", "ovs_interfaceid": "8ef64567-0d19-4a6a-86a7-22a37ef0c882", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_vif [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ef64567-0d, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f487c581-9e8a-48e5-b708-a713b3550899) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:20 user nova-compute[74739]: INFO os_vif [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:2f:94,bridge_name='br-int',has_traffic_filtering=True,id=8ef64567-0d19-4a6a-86a7-22a37ef0c882,network=Network(67c6c28e-fe62-46f0-9b3e-086039c5202b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ef64567-0d')
Oct 25 17:54:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Deleting instance files /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8_del
Oct 25 17:54:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Deletion of /opt/stack/data/nova/instances/59ca18ab-9b5c-4738-b9f6-955dc6e48be8_del complete
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating instance_info_cache with network_info: [{"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cfcb70-d6c3-4314-b164-4d81d0eb574f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260]
Oct 25 17:54:20 user nova-compute[74739]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770, portal: 172.16.0.220,3260] successful.
Oct 25 17:54:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Releasing lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Instance network_info: |[{"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] Acquired lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Refreshing network info cache for port d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Start _get_guest_xml network_info=[{"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:54:20 user nova-compute[74739]: INFO nova.compute.manager [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:54:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69cb53dc-79b3-4e10-ae03-93c970cc8770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c84c30-2c9d-44c6-96cc-c32a5daa2cf5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] <== disconnect_volume: return (430ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1221556',id=19,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoMDXsKaKf8pJnVDNUBJl0dz+3mQHcVjVwyM0lM3UEK8pOdIjZrcsW2o5L2hPmeDG81TdE4a1f7sRfshic6tiaMryBtjvVXR/nW0QW3ZGuL+7bb1R76PHVNKPhUgEhH4A==',key_name='tempest-keypair-756652932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e07a2c34ca0f4b5c9ef15cc25c341952',ramdisk_id='',reservation_id='r-p8dldu06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f1fa0911cff4b7fbbb4ba5096ef7969',uuid=b29f69fa-c815-494c-80ca-fa26973a55c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converting VIF {"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lazy-loading 'pci_devices' on Instance uuid b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:54:20 user nova-compute[74739]:   <uuid>b29f69fa-c815-494c-80ca-fa26973a55c4</uuid>
Oct 25 17:54:20 user nova-compute[74739]:   <name>instance-00000013</name>
Oct 25 17:54:20 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:54:20 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:54:20 user nova-compute[74739]:   <metadata>
Oct 25 17:54:20 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:54:20 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862</nova:name>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:54:20</nova:creationTime>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:54:20 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:54:20 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:owner>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:user uuid="5f1fa0911cff4b7fbbb4ba5096ef7969">tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member</nova:user>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:project uuid="e07a2c34ca0f4b5c9ef15cc25c341952">tempest-TestServerVolumeAttachScenarioOldVersion-329944953</nova:project>
Oct 25 17:54:20 user nova-compute[74739]:       </nova:owner>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:54:20 user nova-compute[74739]:       <nova:ports>
Oct 25 17:54:20 user nova-compute[74739]:         <nova:port uuid="d824bc69-2605-4d52-a156-abae100ada96">
Oct 25 17:54:20 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:54:20 user nova-compute[74739]:         </nova:port>
Oct 25 17:54:20 user nova-compute[74739]:       </nova:ports>
Oct 25 17:54:20 user nova-compute[74739]:     </nova:instance>
Oct 25 17:54:20 user nova-compute[74739]:   </metadata>
Oct 25 17:54:20 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:54:20 user nova-compute[74739]:     <system>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="serial">b29f69fa-c815-494c-80ca-fa26973a55c4</entry>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="uuid">b29f69fa-c815-494c-80ca-fa26973a55c4</entry>
Oct 25 17:54:20 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:54:20 user nova-compute[74739]:     </system>
Oct 25 17:54:20 user nova-compute[74739]:   </sysinfo>
Oct 25 17:54:20 user nova-compute[74739]:   <os>
Oct 25 17:54:20 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:54:20 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:54:20 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:54:20 user nova-compute[74739]:   </os>
Oct 25 17:54:20 user nova-compute[74739]:   <features>
Oct 25 17:54:20 user nova-compute[74739]:     <acpi/>
Oct 25 17:54:20 user nova-compute[74739]:     <apic/>
Oct 25 17:54:20 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:54:20 user nova-compute[74739]:   </features>
Oct 25 17:54:20 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:54:20 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:54:20 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:54:20 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:54:20 user nova-compute[74739]:   </clock>
Oct 25 17:54:20 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:54:20 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:54:20 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:54:20 user nova-compute[74739]:   </cpu>
Oct 25 17:54:20 user nova-compute[74739]:   <devices>
Oct 25 17:54:20 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:54:20 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:54:20 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk"/>
Oct 25 17:54:20 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:54:20 user nova-compute[74739]:     </disk>
Oct 25 17:54:20 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:54:20 user nova-compute[74739]:       <mac address="fa:16:3e:c4:95:22"/>
Oct 25 17:54:20 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:20 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:54:20 user nova-compute[74739]:       <target dev="tapd824bc69-26"/>
Oct 25 17:54:20 user nova-compute[74739]:     </interface>
Oct 25 17:54:20 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:54:20 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/console.log" append="off"/>
Oct 25 17:54:20 user nova-compute[74739]:     </serial>
Oct 25 17:54:20 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:54:20 user nova-compute[74739]:     <video>
Oct 25 17:54:20 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:54:20 user nova-compute[74739]:     </video>
Oct 25 17:54:20 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:54:20 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:54:20 user nova-compute[74739]:     </rng>
Oct 25 17:54:20 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:54:20 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:54:20 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:54:20 user nova-compute[74739]:     </memballoon>
Oct 25 17:54:20 user nova-compute[74739]:   </devices>
Oct 25 17:54:20 user nova-compute[74739]: </domain>
Oct 25 17:54:20 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1221556',id=19,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoMDXsKaKf8pJnVDNUBJl0dz+3mQHcVjVwyM0lM3UEK8pOdIjZrcsW2o5L2hPmeDG81TdE4a1f7sRfshic6tiaMryBtjvVXR/nW0QW3ZGuL+7bb1R76PHVNKPhUgEhH4A==',key_name='tempest-keypair-756652932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e07a2c34ca0f4b5c9ef15cc25c341952',ramdisk_id='',reservation_id='r-p8dldu06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:54:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f1fa0911cff4b7fbbb4ba5096ef7969',uuid=b29f69fa-c815-494c-80ca-fa26973a55c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converting VIF {"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG os_vif [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9021eec-9097-5f88-a098-b9c29037d72a', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd824bc69-26, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd824bc69-26, col_values=(('qos', UUID('4a3b65e4-f191-479e-8d27-b9177d1728f2')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd824bc69-26, col_values=(('external_ids', {'iface-id': 'd824bc69-2605-4d52-a156-abae100ada96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:95:22', 'vm-uuid': 'b29f69fa-c815-494c-80ca-fa26973a55c4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:20 user nova-compute[74739]: INFO os_vif [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26')
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] No VIF found with MAC fa:16:3e:c4:95:22, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updated VIF entry in instance network info cache for port d824bc69-2605-4d52-a156-abae100ada96. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating instance_info_cache with network_info: [{"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dba5171b-357e-4706-8a11-6415419d2962 req-2f350850-18ed-4838-a00c-86a92de4cdad service nova] Releasing lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:21 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Took 0.88 seconds to deallocate network for instance.
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.objects.instance [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'flavor' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7a583bf5-01e4-4688-b430-9c4bb1c3012c tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.volume.cinder [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Update attachment failed for attachment 72147d78-6bb9-40ed-bacb-2e703bd9452d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Traceback (most recent call last):
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     yield
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/compute/manager.py", line 5485, in _finish_revert_resize
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     self._update_volume_attachments(context, instance, bdms)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     self.volume_api.attachment_update(
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     res = method(self, ctx, *args, **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     with excutils.save_and_reraise_exception():
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     self.force_reraise()
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     raise self.value
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     return method.func(obj, *args, **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     resp = self._update('/attachments/%s' % id, body)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     return self.request(url, method, **kwargs)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f]     raise exceptions.from_response(resp, body)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26)
Oct 25 17:54:21 user nova-compute[74739]: ERROR nova.compute.manager [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] 
Oct 25 17:54:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb37a637-7bf4-449d-b291-6986eea005e9 is timed out.
Oct 25 17:54:21 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Successfully detached device vdb from instance cb37a637-7bf4-449d-b291-6986eea005e9 from the live domain config.
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IvhSOefk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:54:21 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21c4f86-0145-43d3-b543-def46a28fc12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:54:21 user nova-compute[74739]: No targets found.
Oct 25 17:54:21 user nova-compute[74739]: iSNS:
Oct 25 17:54:21 user nova-compute[74739]: No targets found.
Oct 25 17:54:21 user nova-compute[74739]: STATIC:
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:54:21 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:54:21 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:54:21 user nova-compute[74739]: FIRMWARE:
Oct 25 17:54:21 user nova-compute[74739]: No targets found.
Oct 25 17:54:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:54:21 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:54:21 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba846cf-bfa2-40c1-a102-b10c81f82998]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37f4dbd-e33f-4572-801a-d6b2df5c217f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:54:21 user nova-compute[74739]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b (non-flash)
Oct 25 17:54:21 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc23dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c47eee-dda5-40cd-84ca-bf6ce97a0824]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4b3d0-9532-4e9e-9b60-bd98056b5b77]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:54:21 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Deleted allocations for instance 59ca18ab-9b5c-4738-b9f6-955dc6e48be8
Oct 25 17:54:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d56eb34-9aee-41b4-b6a9-4e160475603e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-vif-unplugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] No waiting events found dispatching network-vif-unplugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:21 user nova-compute[74739]: WARNING nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received unexpected event network-vif-unplugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 for instance with vm_state deleted and task_state None.
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Acquiring lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] No waiting events found dispatching network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:21 user nova-compute[74739]: WARNING nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received unexpected event network-vif-plugged-8ef64567-0d19-4a6a-86a7-22a37ef0c882 for instance with vm_state deleted and task_state None.
Oct 25 17:54:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-31b45f0b-e8ff-4dd3-8d08-cf73074a9e11 req-daed2aa8-4570-4439-8525-5e81640d842a service nova] [instance: 59ca18ab-9b5c-4738-b9f6-955dc6e48be8] Received event network-vif-deleted-8ef64567-0d19-4a6a-86a7-22a37ef0c882 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e936d0-8ec9-4c9d-8a97-6b0cac188664]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2796c444-e8a2-41fb-baf3-7bfbbb8fe8a0 tempest-TestVolumeSwap-1896463606 tempest-TestVolumeSwap-1896463606-project-member] Lock "59ca18ab-9b5c-4738-b9f6-955dc6e48be8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b816613-4ad7-4245-9984-017f32a5f74b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de897cac-6466-40ce-a6a0-829fb1aa2df2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260]
Oct 25 17:54:22 user nova-compute[74739]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b, portal: 172.16.0.220,3260] successful.
Oct 25 17:54:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be5522d-af74-404d-bf6b-60f854ada82b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7310f5a7-22f6-4f68-82d4-eff8d3421fd6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] <== disconnect_volume: return (466ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] No waiting events found dispatching network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:22 user nova-compute[74739]: WARNING nova.compute.manager [req-1343e80e-1f78-468e-a35b-30ac138021d5 req-fe881c8d-0aa4-4c7a-8065-e6e811270f19 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received unexpected event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 for instance with vm_state building and task_state spawning.
Oct 25 17:54:22 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.640s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:22 user nova-compute[74739]: INFO nova.compute.manager [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Successfully reverted task state from resize_reverting on failure for instance.
Oct 25 17:54:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server [None req-8b2428ee-55f2-466d-80d6-188797a9bb57 tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5419, in finish_revert_resize
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._finish_revert_resize(
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 5485, in _finish_revert_resize
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-e8df40a9-034e-4cd0-a301-275c5a882a26)
Oct 25 17:54:22 user nova-compute[74739]: ERROR oslo_messaging.rpc.server 
Oct 25 17:54:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'flavor' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfee6641-4592-484e-a947-fa8c73379324 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] No waiting events found dispatching network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:24 user nova-compute[74739]: WARNING nova.compute.manager [req-45948d4d-3506-4286-a929-67253f0d2db0 req-b0896e15-a9b0-41aa-a0b4-6622d632edd7 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received unexpected event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 for instance with vm_state building and task_state spawning.
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:54:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Instance spawned successfully.
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:54:24 user nova-compute[74739]: INFO nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Took 6.39 seconds to spawn the instance on the hypervisor.
Oct 25 17:54:24 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:54:24 user nova-compute[74739]: INFO nova.compute.manager [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Took 7.82 seconds to build instance.
Oct 25 17:54:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c7afa00b-709f-4767-a1f3-54068d271ed3 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.951s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-changed-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Refreshing instance network info cache due to event network-changed-728bb0b9-cfcf-4876-b97b-02109cd837da. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] Acquiring lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] Acquired lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Refreshing network info cache for port 728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updated VIF entry in instance network info cache for port 728bb0b9-cfcf-4876-b97b-02109cd837da. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updating instance_info_cache with network_info: [{"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6eeae072-8697-44e2-a646-ba31052b70b5 req-72b42747-8acb-47f0-b898-ffd1dd5ee15a service nova] Releasing lock "refresh_cache-02425b58-f6d0-49f6-bb07-b17608560557" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:54:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:43 user nova-compute[74739]: INFO nova.compute.manager [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Terminating instance
Oct 25 17:54:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-unplugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-unplugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-1ae24cdc-4121-4191-970e-b60625007714 req-4a5b9ad5-127b-4e78-acaf-7def670a759c service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-unplugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Instance destroyed successfully.
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lazy-loading 'resources' on Instance uuid 48dc27d9-c7d2-49bd-aecb-dfee636798f3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1755445749',display_name='tempest-ServersNegativeTestJSON-server-1755445749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1755445749',id=17,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:53:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-u24d1lpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:53:02Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=48dc27d9-c7d2-49bd-aecb-dfee636798f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "address": "fa:16:3e:7b:da:5e", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb795f3a6-b9", "ovs_interfaceid": "b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG os_vif [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb795f3a6-b9, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d2cb645-485e-47ce-aa6c-058db667654e) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:54:44 user nova-compute[74739]: INFO os_vif [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:da:5e,bridge_name='br-int',has_traffic_filtering=True,id=b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb795f3a6-b9')
Oct 25 17:54:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Deleting instance files /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3_del
Oct 25 17:54:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Deletion of /opt/stack/data/nova/instances/48dc27d9-c7d2-49bd-aecb-dfee636798f3_del complete
Oct 25 17:54:44 user nova-compute[74739]: INFO nova.compute.manager [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 17:54:44 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:45 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Took 0.40 seconds to deallocate network for instance.
Oct 25 17:54:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-55a01951-218e-4b85-aaee-8b928deb837d req-a2450c40-b380-4a4a-9609-3602ec5b7788 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-deleted-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:45 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Deleted allocations for instance 48dc27d9-c7d2-49bd-aecb-dfee636798f3
Oct 25 17:54:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6d7119-674b-4563-bdcc-c00fc091a559 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.926s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:46 user nova-compute[74739]: WARNING nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state deleted and task_state None.
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:46 user nova-compute[74739]: WARNING nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state deleted and task_state None.
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:46 user nova-compute[74739]: WARNING nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state deleted and task_state None.
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Acquiring lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] Lock "48dc27d9-c7d2-49bd-aecb-dfee636798f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] No waiting events found dispatching network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:46 user nova-compute[74739]: WARNING nova.compute.manager [req-a42d3c42-f185-40ad-9ba7-fafe47b24b2d req-d82c1c1e-d8c8-459c-b15f-b8e3aae8f227 service nova] [instance: 48dc27d9-c7d2-49bd-aecb-dfee636798f3] Received unexpected event network-vif-plugged-b795f3a6-b9c3-4a4b-8a76-c66f34abcb1f for instance with vm_state deleted and task_state None.
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG nova.objects.instance [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'flavor' on Instance uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:46 user nova-compute[74739]: INFO nova.compute.manager [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Attaching volume 6563cd21-ed60-4b04-b90b-3d2143301f70 to /dev/vdb
Oct 25 17:54:46 user nova-compute[74739]: DEBUG os_brick.utils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff1688-2667-4b54-954a-7899a6df4a6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a29b603-789a-40dd-a6d9-b864e208e9ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a4d88b-c3da-424d-9e9b-b627289f40e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1affc-721f-4a81-9517-64af0bc38fe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:54:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:54:47 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:54:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b43a04e-e82e-4599-b7f9-814fc689990d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG os_brick.utils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:54:47 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updating existing volume attachment record: da787d09-ea02-4906-8342-2c41fbff872f {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:49 user nova-compute[74739]: INFO nova.compute.manager [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Terminating instance
Oct 25 17:54:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-3cf3afc0-f03e-4e31-9840-a4ecee5b776d req-33d7be99-0c6e-4bcf-9903-bd312e57df37 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-unplugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:54:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Instance destroyed successfully.
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'resources' on Instance uuid a8d9aaf2-caff-47c9-9add-1963381511d5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-998219364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-998219364',id=3,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOGwq+E25o3BF77wQI0+sGO22Qpe+iGvi5TaQSpJ2H+kXA6GjlXZjWZzf5GK4BFKu1xMTxPYdVEVeYc5XJVLgHTXy0kDO+/Qq3weG65sLCAhFYmOuur3zQhMOQ7KJ7b5Q==',key_name='tempest-keypair-770018984',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:52:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-7x0oq92t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=a8d9aaf2-caff-47c9-9add-1963381511d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "address": "fa:16:3e:df:c6:b0", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80d38ac3-dd", "ovs_interfaceid": "80d38ac3-dd49-49f5-bd49-64f4495084fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG os_vif [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80d38ac3-dd, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b65abd0-cc2e-4790-a03e-eba70967a9ef) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:50 user nova-compute[74739]: INFO os_vif [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:c6:b0,bridge_name='br-int',has_traffic_filtering=True,id=80d38ac3-dd49-49f5-bd49-64f4495084fa,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80d38ac3-dd')
Oct 25 17:54:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Deleting instance files /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5_del
Oct 25 17:54:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Deletion of /opt/stack/data/nova/instances/a8d9aaf2-caff-47c9-9add-1963381511d5_del complete
Oct 25 17:54:50 user nova-compute[74739]: INFO nova.compute.manager [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 17:54:50 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:54:50 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:51 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Took 0.59 seconds to deallocate network for instance.
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:51 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Deleted allocations for instance a8d9aaf2-caff-47c9-9add-1963381511d5
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5a1f0f48-cec1-4322-be81-97a5d8b03568 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:51 user nova-compute[74739]: INFO nova.compute.manager [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Terminating instance
Oct 25 17:54:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] Acquiring lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] Lock "a8d9aaf2-caff-47c9-9add-1963381511d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] No waiting events found dispatching network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:52 user nova-compute[74739]: WARNING nova.compute.manager [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received unexpected event network-vif-plugged-80d38ac3-dd49-49f5-bd49-64f4495084fa for instance with vm_state deleted and task_state None.
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-58ba1a8f-26c2-4c17-81b1-5b902181d7b8 req-51e7c6e1-fe58-4c53-ba0b-37d5ab932f16 service nova] [instance: a8d9aaf2-caff-47c9-9add-1963381511d5] Received event network-vif-deleted-80d38ac3-dd49-49f5-bd49-64f4495084fa {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Instance destroyed successfully.
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.objects.instance [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lazy-loading 'resources' on Instance uuid cb37a637-7bf4-449d-b291-6986eea005e9 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2122672527',display_name='tempest-ServerStableDeviceRescueTest-server-2122672527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2122672527',id=4,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODut1pNslwSU4Di0lHh0C6EpfYOPqvghmvMnB4Fe1wEhoRAWbRcGpJBWvX1TZnxT/9xSDgreJ/BHuyJHTnD0o6tmk0d7vRiQepNtyDzSQHOe329v/2YQU9JiN9ugtZpxQ==',key_name='tempest-keypair-1409896089',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:51:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9bfb1966da34253bbe550d1dbf97979',ramdisk_id='',reservation_id='r-5vd1zmhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-19504323',owner_user_name='tempest-ServerStableDeviceRescueTest-19504323-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:53:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be7a94af5cae47709995a2d16346740c',uuid=cb37a637-7bf4-449d-b291-6986eea005e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converting VIF {"id": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "address": "fa:16:3e:0a:58:cf", "network": {"id": "808f8119-fb06-49b5-a028-8784b2ed2745", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2123460728-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9bfb1966da34253bbe550d1dbf97979", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f62b72-2e", "ovs_interfaceid": "d7f62b72-2e75-4ead-a8be-5657f0d6b8a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG os_vif [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7f62b72-2e, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a10ff76-72bd-40a6-a1cf-4771c3457550) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:52 user nova-compute[74739]: INFO os_vif [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:58:cf,bridge_name='br-int',has_traffic_filtering=True,id=d7f62b72-2e75-4ead-a8be-5657f0d6b8a1,network=Network(808f8119-fb06-49b5-a028-8784b2ed2745),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f62b72-2e')
Oct 25 17:54:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Deleting instance files /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9_del
Oct 25 17:54:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Deletion of /opt/stack/data/nova/instances/cb37a637-7bf4-449d-b291-6986eea005e9_del complete
Oct 25 17:54:52 user nova-compute[74739]: INFO nova.compute.manager [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 25 17:54:52 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:54:52 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:54:53 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:54:53 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Took 0.59 seconds to deallocate network for instance.
Oct 25 17:54:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:53 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:54:53 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:54:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:53 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Deleted allocations for instance cb37a637-7bf4-449d-b291-6986eea005e9
Oct 25 17:54:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7ca05e63-456f-45cf-bf52-8bacf748efa0 tempest-ServerStableDeviceRescueTest-19504323 tempest-ServerStableDeviceRescueTest-19504323-project-member] Lock "cb37a637-7bf4-449d-b291-6986eea005e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.918s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:54 user nova-compute[74739]: WARNING nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-unplugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state deleted and task_state None.
Oct 25 17:54:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Acquiring lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] Lock "cb37a637-7bf4-449d-b291-6986eea005e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] No waiting events found dispatching network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:54:54 user nova-compute[74739]: WARNING nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received unexpected event network-vif-plugged-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 for instance with vm_state deleted and task_state None.
Oct 25 17:54:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-0f1295f6-3582-4159-9d51-c6a284003e32 req-0413f859-befc-4824-968c-f6a5e1e00251 service nova] [instance: cb37a637-7bf4-449d-b291-6986eea005e9] Received event network-vif-deleted-d7f62b72-2e75-4ead-a8be-5657f0d6b8a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:54:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:54:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQVlPONv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:04 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a109ac90-5d3d-4b5b-9ce4-c310a734e333]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:55:04 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[602280af-b7b1-411a-be80-abb2294f5124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70] added
Oct 25 17:55:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2fad8c-b44d-47a9-83c5-28dc3be684aa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56366ff-18ce-467d-a99e-ff1ce84d880d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQVlPONv {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQVlPONv" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[219f60cf-9559-4de9-87ae-a9d208cbf0b8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DQVlPONv'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f64bc9b-0d66-4559-8b14-19aae9cc215d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[25058195-f32f-49b6-84d1-73f88cb6e3b8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b68437-b22a-4e5c-b5ff-ffd87af39efa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260]
Oct 25 17:55:05 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fdff6f-aa5c-4b7c-9d47-53adc1367216]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3386a23-82d5-42e6-97bc-192dbd137c48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fc69ac-e489-4d67-aafc-ea740eab8555]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:55:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQVlPONv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26535623639346236', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535623639346236', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'flavor' on Instance uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:55:06 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:55:06 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:55:06 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:55:06 user nova-compute[74739]:   <serial>6563cd21-ed60-4b04-b90b-3d2143301f70</serial>
Oct 25 17:55:06 user nova-compute[74739]: </disk>
Oct 25 17:55:06 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No VIF found with MAC fa:16:3e:dd:0e:84, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:55:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-548fb96d-5fb3-4205-b6fc-313b8ec973cc tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.992s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:07 user nova-compute[74739]: INFO nova.compute.manager [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Detaching volume 6563cd21-ed60-4b04-b90b-3d2143301f70
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:07 user nova-compute[74739]: INFO nova.virt.block_device [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Attempting to driver detach volume 6563cd21-ed60-4b04-b90b-3d2143301f70 from mountpoint /dev/vdb
Oct 25 17:55:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Attempting to detach device vdb from instance 02425b58-f6d0-49f6-bb07-b17608560557 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:55:07 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:55:07 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:55:07 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:55:07 user nova-compute[74739]:   <serial>6563cd21-ed60-4b04-b90b-3d2143301f70</serial>
Oct 25 17:55:07 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:55:07 user nova-compute[74739]: </disk>
Oct 25 17:55:07 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:55:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully detached device vdb from instance 02425b58-f6d0-49f6-bb07-b17608560557 from the persistent domain config.
Oct 25 17:55:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02425b58-f6d0-49f6-bb07-b17608560557 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:55:07 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:55:07 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 17:55:07 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:55:07 user nova-compute[74739]:   <serial>6563cd21-ed60-4b04-b90b-3d2143301f70</serial>
Oct 25 17:55:07 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:55:07 user nova-compute[74739]: </disk>
Oct 25 17:55:07 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:11 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:11 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.147994995117188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Applying migration context for instance 7926c5ce-2435-4493-813f-4dca6e1f204f as it has an incoming, in-progress migration 832e3d52-9ab1-4042-bc88-7e39d31810a0. Migration status is error {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74739) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7926c5ce-2435-4493-813f-4dca6e1f204f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 12e498ae-bfa5-4cfb-b9be-7358e38b736e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b29f69fa-c815-494c-80ca-fa26973a55c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:55:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing instance network info cache due to event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated VIF entry in instance network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-57af3376-100c-46c5-ad98-9819bf48e596 req-ff7200c1-7bed-4c66-a409-e746ff20d6bc service nova] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing instance network info cache due to event network-changed-ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Refreshing network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [{"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-7926c5ce-2435-4493-813f-4dca6e1f204f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:13 user nova-compute[74739]: INFO nova.compute.manager [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Detaching volume ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:13 user nova-compute[74739]: INFO nova.virt.block_device [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Attempting to driver detach volume ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 from mountpoint /dev/vdb
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Attempting to detach device vdb from instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:55:13 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:55:13 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:55:13 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:55:13 user nova-compute[74739]:   <serial>ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293</serial>
Oct 25 17:55:13 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 17:55:13 user nova-compute[74739]: </disk>
Oct 25 17:55:13 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:55:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully detached device vdb from instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 from the persistent domain config.
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:55:13 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:55:13 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:55:13 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:55:13 user nova-compute[74739]:   <serial>ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293</serial>
Oct 25 17:55:13 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 17:55:13 user nova-compute[74739]: </disk>
Oct 25 17:55:13 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.network.neutron [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated VIF entry in instance network info cache for port ff881ee6-9485-4a9d-a60f-623bbf5169a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.network.neutron [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6cc9cad2-3e17-4607-99cd-83ca92d75ee0 req-168df42d-1139-4236-80d7-93338d5f304d service nova] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:55:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-changed-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing instance network info cache due to event network-changed-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] Acquiring lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] Acquired lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:26 user nova-compute[74739]: DEBUG nova.network.neutron [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Refreshing network info cache for port 5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:27 user nova-compute[74739]: DEBUG nova.network.neutron [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updated VIF entry in instance network info cache for port 5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:27 user nova-compute[74739]: DEBUG nova.network.neutron [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e9e16db-0220-4b55-bbd3-396683737d1b req-f271c930-cee2-4d1e-9421-3fcc9af8a554 service nova] Releasing lock "refresh_cache-12e498ae-bfa5-4cfb-b9be-7358e38b736e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:28 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02425b58-f6d0-49f6-bb07-b17608560557 is timed out.
Oct 25 17:55:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully detached device vdb from instance 02425b58-f6d0-49f6-bb07-b17608560557 from the live domain config.
Oct 25 17:55:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQVlPONv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5083a6-9f26-422b-bc0b-a0ddd4f3b12c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:28 user nova-compute[74739]: No targets found.
Oct 25 17:55:28 user nova-compute[74739]: iSNS:
Oct 25 17:55:28 user nova-compute[74739]: No targets found.
Oct 25 17:55:28 user nova-compute[74739]: STATIC:
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:55:28 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:28 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:28 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:28 user nova-compute[74739]: No targets found.
Oct 25 17:55:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:28 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:28 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd893b13-52bd-4ac0-8b47-a883da595b31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd941428-464d-436c-9764-b31d49dce36a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc23d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f07b55-6a35-4788-8949-e6f93feaae2f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f85fffb-bd3d-4280-b3c7-6660ba0bb7f9]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9422d7-c1b1-4b6f-a85b-617921f10acd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5c6be7-0a61-484b-8cba-dbed8c861fb0]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30d0eab-3ef5-4e31-804a-5ba3fc3a33a1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a28ebe2-f360-4e3b-8ffa-2031034a6196]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260]
Oct 25 17:55:28 user nova-compute[74739]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6563cd21-ed60-4b04-b90b-3d2143301f70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38851b43-3962-40b4-8a76-1c40ca49c3df]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] <== disconnect_volume: return (328ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:28 user nova-compute[74739]: INFO nova.compute.manager [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Terminating instance
Oct 25 17:55:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-42768c53-1325-4960-98c0-40f27a3b4158 req-99fe193b-2bb7-49f1-93c2-a23588654cf1 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'flavor' on Instance uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c6d8521f-18a1-4ae8-8f3d-48afca4f1868 tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.825s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-9ebc255b-8c37-49f3-8a0b-b0385083becd req-99a413a3-326a-46e8-93bb-73678c5da0b2 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-1b99c674-e473-4d18-ad8a-bf79b84eef34 req-acc55e0f-212d-40ad-8823-6fb45208bcea service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Instance destroyed successfully.
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lazy-loading 'resources' on Instance uuid 12e498ae-bfa5-4cfb-b9be-7358e38b736e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e0e7612-16, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86c760ab-08b5-4a02-b504-efb5a0024bc5) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:9e:cd,bridge_name='br-int',has_traffic_filtering=True,id=5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d,network=Network(ce41f7bf-38e5-4bca-80c9-b49b508bb42c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e0e7612-16')
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd976bd9f-4b, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e822287-629f-40e4-85a4-7e1950b7eb27) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:30 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:cc:08,bridge_name='br-int',has_traffic_filtering=True,id=d976bd9f-4b53-416c-92e8-4404ffb75ed9,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd976bd9f-4b')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f6caff-3f, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c08ef613-81fe-4b7a-8e60-0b6722f24637) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:05:ab,bridge_name='br-int',has_traffic_filtering=True,id=d4f6caff-3f68-4d0e-b8ae-0608a5c90420,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f6caff-3f')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ca4d4ff-64, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6df7b3a6-5156-4185-b67a-4ba7c1874013) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:f3:3a,bridge_name='br-int',has_traffic_filtering=True,id=4ca4d4ff-6445-44cd-9cfd-7b562de402ac,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ca4d4ff-64')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4105aeeb-1f, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2dad047b-80ee-4099-9201-6df522301cf8) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:1e:7a,bridge_name='br-int',has_traffic_filtering=True,id=4105aeeb-1f9d-48bb-8af3-f535cf468fc0,network=Network(bd6cbb35-e0ce-433d-8a17-e79c99a873cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4105aeeb-1f')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a3a58c1-f3, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebd828c8-0dd5-4ae9-8c7f-b8e3468ce31d) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:0c:ba,bridge_name='br-int',has_traffic_filtering=True,id=7a3a58c1-f319-4e81-a0f6-c364de654b0f,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a3a58c1-f3')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T17:52:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2096524215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2096524215',id=15,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv4lWzhBlNze/AmhnV+VwQrY6ACMiU2pKIS/d950hRBOQXJKPMs4JYMY1wWu+dWmcRYzn9LiaMmEO75fwMvSd8uxHOeggEsAsFAmRTm/y1tHLzaDcZm3xwiMqaVtYsdMA==',key_name='tempest-keypair-1300993976',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c7dc105cff340a4810f5d05bceac2b4',ramdisk_id='',reservation_id='r-qvzfmul6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1402920458',owner_user_name='tempest-TaggedBootDevicesTest-1402920458-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa6bda843240427eb6f7f95a38718afb',uuid=12e498ae-bfa5-4cfb-b9be-7358e38b736e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converting VIF {"id": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "address": "fa:16:3e:ac:75:c9", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef007ab4-6e", "ovs_interfaceid": "ef007ab4-6e9c-4df5-b2b5-df3227795967", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef007ab4-6e, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5012c63f-01ab-480a-b5dd-e81237fffb8d) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:31 user nova-compute[74739]: INFO os_vif [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:75:c9,bridge_name='br-int',has_traffic_filtering=True,id=ef007ab4-6e9c-4df5-b2b5-df3227795967,network=Network(67b5f65a-c424-44fb-8bc0-6868f195abac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef007ab4-6e')
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwpPqAbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb32a074-04cc-41f3-b2f6-615ed6bd5eb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: iSNS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: STATIC:
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:31 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[08573adb-81c6-457d-92fd-85932a22dc56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d4f6caff-3f68-4d0e-b8ae-0608a5c90420 for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-0682676e-b0d4-4404-b99e-cf1021acd51d req-18d5429e-ea4c-4c8b-8018-9abc1e896c7a service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-7a3a58c1-f319-4e81-a0f6-c364de654b0f for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3900db64-f5ad-4ec8-9659-3e2a91983f6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc6d70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d847952b-2471-4b4f-9a88-bb8b2d20a12f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9f5e0-74ed-4710-aa25-664714286084]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69869d5-ef83-4286-ba0e-88c6631d3528]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[417dfd7f-aa68-4e3d-8853-8a119f600a72]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb234cc-c226-40fe-88db-0cbf870b456f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab14bee-baf7-4b73-9931-7ad98cffdbe7]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260]
Oct 25 17:55:31 user nova-compute[74739]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d70c0f25-9b74-4984-a309-c8ddffeae443 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[432a257e-f574-4d00-9ac6-7fde1f4dfe63]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== disconnect_volume: return (331ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iQZslEnd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ce7cf-42aa-4f1b-989c-6a0abe8d45c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: iSNS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: STATIC:
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:31 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1ae63-4c25-4201-8d04-a6a801d2fb22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0638d8-ea6b-425b-a797-2c360ea2bf19]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:31 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7'): ({'sdh'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Removing single pathed devices sdh {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[26813c62-dc7a-44ef-8d71-c82e799e78ba]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[119e32fa-6f7d-4f6f-8e7e-c5d0fc1f8971]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Flushing IO for device /dev/sdh {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20f195c-4f53-42a6-9ec4-ddc2a27d7656]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ebf0a-6d7c-43ce-b37b-131d3aa677f6]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] SCSI volumes sdh have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7204cc-5da3-4087-8bb3-309ebdfc00a7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-ee86ed0d-4844-45d0-b385-3d7900a93f2e req-48ec0894-83f2-4bf3-ad4d-d2ae518d7f4e service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-d976bd9f-4b53-416c-92e8-4404ffb75ed9 for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4ca4d4ff-6445-44cd-9cfd-7b562de402ac for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-unplugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-unplugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Acquiring lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] No waiting events found dispatching network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING nova.compute.manager [req-a2937066-3e93-44de-8df6-e9cb1dc969be req-124b0950-fafb-47fe-90bf-33a1c65e56bc service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received unexpected event network-vif-plugged-ef007ab4-6e9c-4df5-b2b5-df3227795967 for instance with vm_state active and task_state deleting.
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37e1e38-58a9-4e8f-8dc4-17ed4357b87d]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260]
Oct 25 17:55:31 user nova-compute[74739]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5342404-8ab2-44bc-992c-d72d14d618a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b931c8c-7d6f-4dda-9de3-fb7323b911f5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== disconnect_volume: return (322ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBmvNZMR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[974bf0fa-8b9f-4338-b24e-e970b7023dc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: iSNS:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]: STATIC:
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:31 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:31 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:31 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:31 user nova-compute[74739]: No targets found.
Oct 25 17:55:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:31 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:31 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3aa51-badc-40b3-8f66-d2ae6447fb36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e261d4-5268-4f8c-8da7-dcb1c60b08d5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:32 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:32 user nova-compute[74739]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf (non-flash)
Oct 25 17:55:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf'): ({'sdf'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Removing single pathed devices sdf {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877e3a9-91bd-46c8-9ffc-7fc9268d685d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b631d05d-5ded-4a0b-92c7-68244169f05d]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Flushing IO for device /dev/sdf {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc29cfb-621c-4695-89d3-e11369ca1f7f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb886e-ccdd-48ff-a0ae-f5a18996e4bb]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd4c63a-523d-4595-a1b0-217fdaca0506]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a45b91-9fa3-49f7-9c44-8d63a8448d74]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260]
Oct 25 17:55:32 user nova-compute[74739]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d20dfb55-20be-42b9-90ed-12e7a5d82caf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4b9042-347b-4588-9e78-8febb05ebd6c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] <== disconnect_volume: return (296ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Deleting instance files /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e_del
Oct 25 17:55:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Deletion of /opt/stack/data/nova/instances/12e498ae-bfa5-4cfb-b9be-7358e38b736e_del complete
Oct 25 17:55:32 user nova-compute[74739]: INFO nova.compute.manager [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Took 3.49 seconds to destroy the instance on the hypervisor.
Oct 25 17:55:32 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:55:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 is timed out.
Oct 25 17:55:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully detached device vdb from instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 from the live domain config.
Oct 25 17:55:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzhWsRak', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:33 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2954d9-b61f-49a8-8580-537d0bfb2690]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:33 user nova-compute[74739]: No targets found.
Oct 25 17:55:33 user nova-compute[74739]: iSNS:
Oct 25 17:55:33 user nova-compute[74739]: No targets found.
Oct 25 17:55:33 user nova-compute[74739]: STATIC:
Oct 25 17:55:33 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293
Oct 25 17:55:33 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:33 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:33 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:33 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:33 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:33 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:33 user nova-compute[74739]: No targets found.
Oct 25 17:55:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:33 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:33 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcaea86-593a-4e0c-9e96-894015e10b27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b624cab-ff16-42cb-9c6c-01eef9f413ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:33 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 (non-flash)
Oct 25 17:55:33 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[832f788f-9df5-4c1a-904e-ebd8d420a7da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9100c7c-6e4b-48a3-9202-194755532314]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d8333-5ea1-4fe9-b532-e1f66f1a126d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-7407ec68-a406-4646-b995-ec4b9e575964 req-c02823a2-5cc5-43e5-a525-7b1f817694bb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-deleted-ef007ab4-6e9c-4df5-b2b5-df3227795967 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:33 user nova-compute[74739]: INFO nova.compute.manager [req-7407ec68-a406-4646-b995-ec4b9e575964 req-c02823a2-5cc5-43e5-a525-7b1f817694bb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Neutron deleted interface ef007ab4-6e9c-4df5-b2b5-df3227795967; detaching it from the instance and deleting it from the info cache
Oct 25 17:55:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-7407ec68-a406-4646-b995-ec4b9e575964 req-c02823a2-5cc5-43e5-a525-7b1f817694bb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [{"id": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "address": "fa:16:3e:7b:9e:cd", "network": {"id": "ce41f7bf-38e5-4bca-80c9-b49b508bb42c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-448633796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e0e7612-16", "ovs_interfaceid": "5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "address": "fa:16:3e:c0:cc:08", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.217", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd976bd9f-4b", "ovs_interfaceid": "d976bd9f-4b53-416c-92e8-4404ffb75ed9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "address": "fa:16:3e:ed:05:ab", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f6caff-3f", "ovs_interfaceid": "d4f6caff-3f68-4d0e-b8ae-0608a5c90420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "address": "fa:16:3e:fc:f3:3a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ca4d4ff-64", "ovs_interfaceid": "4ca4d4ff-6445-44cd-9cfd-7b562de402ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "address": "fa:16:3e:c6:1e:7a", "network": {"id": "bd6cbb35-e0ce-433d-8a17-e79c99a873cd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1905226853", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4105aeeb-1f", "ovs_interfaceid": "4105aeeb-1f9d-48bb-8af3-f535cf468fc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "address": "fa:16:3e:90:0c:ba", "network": {"id": "67b5f65a-c424-44fb-8bc0-6868f195abac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1463694643", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8c7dc105cff340a4810f5d05bceac2b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a3a58c1-f3", "ovs_interfaceid": "7a3a58c1-f319-4e81-a0f6-c364de654b0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d816568-5aa3-4ab1-9001-f581e8465f00]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-7407ec68-a406-4646-b995-ec4b9e575964 req-c02823a2-5cc5-43e5-a525-7b1f817694bb service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Detach interface failed, port_id=ef007ab4-6e9c-4df5-b2b5-df3227795967, reason: Instance 12e498ae-bfa5-4cfb-b9be-7358e38b736e could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5cc66-9beb-4881-b0ba-ce26823bd1a8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b248908-690f-4185-9808-dd709ebd6e51]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260]
Oct 25 17:55:34 user nova-compute[74739]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293, portal: 172.16.0.220,3260] successful.
Oct 25 17:55:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9ba8b9-c013-4ea8-8d50-69a4a1ae9293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd8cc2-2e3f-405b-8d3d-989f8faf1402]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== disconnect_volume: return (316ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-40de11c0-3258-45cb-a8be-2fa687c4073a tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:35 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Took 3.65 seconds to deallocate network for instance.
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-146028b6-27e7-4485-aed5-53fd9094de0d req-cda63b31-9fec-4ed2-a419-07d72e1847f7 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-deleted-4ca4d4ff-6445-44cd-9cfd-7b562de402ac {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-146028b6-27e7-4485-aed5-53fd9094de0d req-cda63b31-9fec-4ed2-a419-07d72e1847f7 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-deleted-4105aeeb-1f9d-48bb-8af3-f535cf468fc0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-146028b6-27e7-4485-aed5-53fd9094de0d req-cda63b31-9fec-4ed2-a419-07d72e1847f7 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-deleted-7a3a58c1-f319-4e81-a0f6-c364de654b0f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-146028b6-27e7-4485-aed5-53fd9094de0d req-cda63b31-9fec-4ed2-a419-07d72e1847f7 service nova] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Received event network-vif-deleted-5e0e7612-16fe-4a0a-bc57-f44ef73e8d9d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.compute.manager [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Terminating instance
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] During wait destroy, instance disappeared. {{(pid=74739) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance destroyed successfully.
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lazy-loading 'resources' on Instance uuid 7926c5ce-2435-4493-813f-4dca6e1f204f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-660238142',display_name='tempest-ServerActionsTestOtherB-server-660238142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-660238142',id=5,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPtjeF7mwlt9tHJdus65UUHjuWGHvXLme9otvzrlxKs7Pg3Ez6Uy/cpvnLGaKA16+Dn315wJNpkK9WowUzhWfEOdNBJnSGk06FV+GNF22OAE9FJ8ocPd8ydegjXgttecg==',key_name='tempest-keypair-1923631098',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:52:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d1d84fb43034e9d9f6cf85063763000',ramdisk_id='',reservation_id='r-twggv1de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1769246220',owner_user_name='tempest-ServerActionsTestOtherB-1769246220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ace8d9977bb4a0f869bec3b8e79e2cd',uuid=7926c5ce-2435-4493-813f-4dca6e1f204f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converting VIF {"id": "1a7792b1-73e4-43a3-b106-01d131c00444", "address": "fa:16:3e:07:4a:54", "network": {"id": "55a4574c-6682-4904-be4b-e6ba58dd1bb1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-350208022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d1d84fb43034e9d9f6cf85063763000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a7792b1-73", "ovs_interfaceid": "1a7792b1-73e4-43a3-b106-01d131c00444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_vif [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a7792b1-73, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:55:38 user nova-compute[74739]: INFO os_vif [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:4a:54,bridge_name='br-int',has_traffic_filtering=True,id=1a7792b1-73e4-43a3-b106-01d131c00444,network=Network(55a4574c-6682-4904-be4b-e6ba58dd1bb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a7792b1-73')
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuUoEqNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:38 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5421253-5127-4b10-b89c-e8b69cbbc546]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:55:38 user nova-compute[74739]: No targets found.
Oct 25 17:55:38 user nova-compute[74739]: iSNS:
Oct 25 17:55:38 user nova-compute[74739]: No targets found.
Oct 25 17:55:38 user nova-compute[74739]: STATIC:
Oct 25 17:55:38 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:55:38 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:55:38 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:55:38 user nova-compute[74739]: FIRMWARE:
Oct 25 17:55:38 user nova-compute[74739]: No targets found.
Oct 25 17:55:38 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:55:38 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:55:38 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab2f5ae7-580d-4288-880e-8b8102af5b8a', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839dbc2-6f78-4763-86c2-968dc6e8f739]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14777292-238e-4664-9d6b-fb905f17c73a]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:38 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:55:38 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc367760>, {}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Disconnecting from: [] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] <== disconnect_volume: return (69ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deletion of /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize failed
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.compute.manager [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Took 0.17 seconds to destroy the instance on the hypervisor.
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.compute.manager [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] [instance: 12e498ae-bfa5-4cfb-b9be-7358e38b736e] Took 2.72 seconds to detach 3 volumes for instance.
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:38 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:38 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Took 0.74 seconds to deallocate network for instance.
Oct 25 17:55:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:39 user nova-compute[74739]: INFO nova.compute.manager [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Took 0.13 seconds to detach 1 volumes for instance.
Oct 25 17:55:39 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Deleted allocations for instance 12e498ae-bfa5-4cfb-b9be-7358e38b736e
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0519b588-a198-4ba9-8341-49a4bffa8a77 tempest-TaggedBootDevicesTest-1402920458 tempest-TaggedBootDevicesTest-1402920458-project-member] Lock "12e498ae-bfa5-4cfb-b9be-7358e38b736e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.424s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG nova.compute.manager [req-31e166a3-468c-4dd1-83be-b998fceb2033 req-cf7314b6-d374-4463-a551-02cbb24a088e service nova] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Received event network-vif-deleted-1a7792b1-73e4-43a3-b106-01d131c00444 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:39 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Deleted allocations for instance 7926c5ce-2435-4493-813f-4dca6e1f204f
Oct 25 17:55:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4c349cc-596e-4b7f-91e6-6b02c585c3ae tempest-ServerActionsTestOtherB-1769246220 tempest-ServerActionsTestOtherB-1769246220-project-member] Lock "7926c5ce-2435-4493-813f-4dca6e1f204f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.566s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 3169-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:55:43 user nova-compute[74739]: INFO nova.compute.claims [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Claim successful on node user
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:55:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.policy [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e140ed4e3e2f4d5abc2e08e1400715de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2a1dd2b0954a74be154b7082170334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:55:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Creating image(s)
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk 1073741824" returned: 0 in 0.055s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Successfully created port: 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Cannot resize image /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Ensure instance console log exists: /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Successfully updated port: 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing instance network info cache due to event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance network_info: |[{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start _get_guest_xml network_info=[{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:55:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf5ADe13sKGNtLF+nRidm4gdmMPSRnreZfu75U2a81p4V/dbYBYxySzqYKBQuDuc8XbXPVuioircPq9BYkWt1NPUViQnfi/UF5Ld/kW8Z87VY6dy6sPk5Ba5xD4mZ50HA==',key_name='tempest-keypair-1385679357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_devices' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:55:45 user nova-compute[74739]:   <uuid>4425dd16-6194-48f7-8cd9-a956167c5cc4</uuid>
Oct 25 17:55:45 user nova-compute[74739]:   <name>instance-00000014</name>
Oct 25 17:55:45 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:55:45 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:55:45 user nova-compute[74739]:   <metadata>
Oct 25 17:55:45 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:55:45 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1908865262</nova:name>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:55:45</nova:creationTime>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:55:45 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:55:45 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:owner>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:user uuid="e140ed4e3e2f4d5abc2e08e1400715de">tempest-AttachVolumeShelveTestJSON-744521439-project-member</nova:user>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:project uuid="6c2a1dd2b0954a74be154b7082170334">tempest-AttachVolumeShelveTestJSON-744521439</nova:project>
Oct 25 17:55:45 user nova-compute[74739]:       </nova:owner>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:55:45 user nova-compute[74739]:       <nova:ports>
Oct 25 17:55:45 user nova-compute[74739]:         <nova:port uuid="6e9eb48b-a500-4a34-b011-fc2342c2b2de">
Oct 25 17:55:45 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 17:55:45 user nova-compute[74739]:         </nova:port>
Oct 25 17:55:45 user nova-compute[74739]:       </nova:ports>
Oct 25 17:55:45 user nova-compute[74739]:     </nova:instance>
Oct 25 17:55:45 user nova-compute[74739]:   </metadata>
Oct 25 17:55:45 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:55:45 user nova-compute[74739]:     <system>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="serial">4425dd16-6194-48f7-8cd9-a956167c5cc4</entry>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="uuid">4425dd16-6194-48f7-8cd9-a956167c5cc4</entry>
Oct 25 17:55:45 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:55:45 user nova-compute[74739]:     </system>
Oct 25 17:55:45 user nova-compute[74739]:   </sysinfo>
Oct 25 17:55:45 user nova-compute[74739]:   <os>
Oct 25 17:55:45 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:55:45 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:55:45 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:55:45 user nova-compute[74739]:   </os>
Oct 25 17:55:45 user nova-compute[74739]:   <features>
Oct 25 17:55:45 user nova-compute[74739]:     <acpi/>
Oct 25 17:55:45 user nova-compute[74739]:     <apic/>
Oct 25 17:55:45 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:55:45 user nova-compute[74739]:   </features>
Oct 25 17:55:45 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:55:45 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:55:45 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:55:45 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:55:45 user nova-compute[74739]:   </clock>
Oct 25 17:55:45 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:55:45 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:55:45 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:55:45 user nova-compute[74739]:   </cpu>
Oct 25 17:55:45 user nova-compute[74739]:   <devices>
Oct 25 17:55:45 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:55:45 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:55:45 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk"/>
Oct 25 17:55:45 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:55:45 user nova-compute[74739]:     </disk>
Oct 25 17:55:45 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:55:45 user nova-compute[74739]:       <mac address="fa:16:3e:b9:2f:6e"/>
Oct 25 17:55:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:55:45 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:55:45 user nova-compute[74739]:       <target dev="tap6e9eb48b-a5"/>
Oct 25 17:55:45 user nova-compute[74739]:     </interface>
Oct 25 17:55:45 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:55:45 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/console.log" append="off"/>
Oct 25 17:55:45 user nova-compute[74739]:     </serial>
Oct 25 17:55:45 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:55:45 user nova-compute[74739]:     <video>
Oct 25 17:55:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:55:45 user nova-compute[74739]:     </video>
Oct 25 17:55:45 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:55:45 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:55:45 user nova-compute[74739]:     </rng>
Oct 25 17:55:45 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:55:45 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:55:45 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:55:45 user nova-compute[74739]:     </memballoon>
Oct 25 17:55:45 user nova-compute[74739]:   </devices>
Oct 25 17:55:45 user nova-compute[74739]: </domain>
Oct 25 17:55:45 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf5ADe13sKGNtLF+nRidm4gdmMPSRnreZfu75U2a81p4V/dbYBYxySzqYKBQuDuc8XbXPVuioircPq9BYkWt1NPUViQnfi/UF5Ld/kW8Z87VY6dy6sPk5Ba5xD4mZ50HA==',key_name='tempest-keypair-1385679357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG os_vif [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18ddc989-9e1e-5625-b894-19df3bc727a0', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9eb48b-a5, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e9eb48b-a5, col_values=(('qos', UUID('7b7fbc5f-2a01-4bc2-9860-a6ba1990ea74')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e9eb48b-a5, col_values=(('external_ids', {'iface-id': '6e9eb48b-a500-4a34-b011-fc2342c2b2de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2f:6e', 'vm-uuid': '4425dd16-6194-48f7-8cd9-a956167c5cc4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:45 user nova-compute[74739]: INFO os_vif [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5')
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No VIF found with MAC fa:16:3e:b9:2f:6e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updated VIF entry in instance network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-97a2ebc7-5119-4959-a2c5-9c500868ea5f req-e01df736-db37-440b-b42a-0a66eaa3cb4a service nova] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:55:47 user nova-compute[74739]: INFO nova.compute.claims [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Claim successful on node user
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:55:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.policy [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73137a888d964149abda3bcac8293e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1631249d25ff403daae6c41e03fd040f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:55:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Creating image(s)
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.201s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk 1073741824" returned: 0 in 0.048s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Successfully created port: b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Cannot resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Ensure instance console log exists: /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:55:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance spawned successfully.
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:49 user nova-compute[74739]: INFO nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:49 user nova-compute[74739]: WARNING nova.compute.manager [req-331c1879-53dc-49fe-bd69-91ecb2da4ae5 req-28d5263a-4fb8-4805-a5b8-ce3893ab43b6 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state building and task_state spawning.
Oct 25 17:55:49 user nova-compute[74739]: INFO nova.compute.manager [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Took 6.41 seconds to build instance.
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca6ee1a5-ded9-400d-9cd0-da831b9125d3 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.529s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Successfully updated port: b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-changed-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Refreshing instance network info cache due to event network-changed-b50c4378-46f7-449b-8c0b-1c4082488139. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance network_info: |[{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.neutron [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Refreshing network info cache for port b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start _get_guest_xml network_info=[{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:55:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.objects.instance [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'pci_devices' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:55:50 user nova-compute[74739]:   <uuid>f9569bc3-c6d4-4eb1-9a6f-73549952097f</uuid>
Oct 25 17:55:50 user nova-compute[74739]:   <name>instance-00000015</name>
Oct 25 17:55:50 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:55:50 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:55:50 user nova-compute[74739]:   <metadata>
Oct 25 17:55:50 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:55:50 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeTestJSON-server-1114405803</nova:name>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:55:50</nova:creationTime>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:55:50 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:55:50 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:owner>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:user uuid="73137a888d964149abda3bcac8293e01">tempest-AttachVolumeTestJSON-1878388259-project-member</nova:user>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:project uuid="1631249d25ff403daae6c41e03fd040f">tempest-AttachVolumeTestJSON-1878388259</nova:project>
Oct 25 17:55:50 user nova-compute[74739]:       </nova:owner>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:55:50 user nova-compute[74739]:       <nova:ports>
Oct 25 17:55:50 user nova-compute[74739]:         <nova:port uuid="b50c4378-46f7-449b-8c0b-1c4082488139">
Oct 25 17:55:50 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 17:55:50 user nova-compute[74739]:         </nova:port>
Oct 25 17:55:50 user nova-compute[74739]:       </nova:ports>
Oct 25 17:55:50 user nova-compute[74739]:     </nova:instance>
Oct 25 17:55:50 user nova-compute[74739]:   </metadata>
Oct 25 17:55:50 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:55:50 user nova-compute[74739]:     <system>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="serial">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="uuid">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 17:55:50 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:55:50 user nova-compute[74739]:     </system>
Oct 25 17:55:50 user nova-compute[74739]:   </sysinfo>
Oct 25 17:55:50 user nova-compute[74739]:   <os>
Oct 25 17:55:50 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:55:50 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:55:50 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:55:50 user nova-compute[74739]:   </os>
Oct 25 17:55:50 user nova-compute[74739]:   <features>
Oct 25 17:55:50 user nova-compute[74739]:     <acpi/>
Oct 25 17:55:50 user nova-compute[74739]:     <apic/>
Oct 25 17:55:50 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:55:50 user nova-compute[74739]:   </features>
Oct 25 17:55:50 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:55:50 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:55:50 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:55:50 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:55:50 user nova-compute[74739]:   </clock>
Oct 25 17:55:50 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:55:50 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:55:50 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:55:50 user nova-compute[74739]:   </cpu>
Oct 25 17:55:50 user nova-compute[74739]:   <devices>
Oct 25 17:55:50 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:55:50 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:55:50 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk"/>
Oct 25 17:55:50 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:55:50 user nova-compute[74739]:     </disk>
Oct 25 17:55:50 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:55:50 user nova-compute[74739]:       <mac address="fa:16:3e:15:58:53"/>
Oct 25 17:55:50 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:55:50 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:55:50 user nova-compute[74739]:       <target dev="tapb50c4378-46"/>
Oct 25 17:55:50 user nova-compute[74739]:     </interface>
Oct 25 17:55:50 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:55:50 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/console.log" append="off"/>
Oct 25 17:55:50 user nova-compute[74739]:     </serial>
Oct 25 17:55:50 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:55:50 user nova-compute[74739]:     <video>
Oct 25 17:55:50 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:55:50 user nova-compute[74739]:     </video>
Oct 25 17:55:50 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:55:50 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:55:50 user nova-compute[74739]:     </rng>
Oct 25 17:55:50 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:55:50 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:55:50 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:55:50 user nova-compute[74739]:     </memballoon>
Oct 25 17:55:50 user nova-compute[74739]:   </devices>
Oct 25 17:55:50 user nova-compute[74739]: </domain>
Oct 25 17:55:50 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG os_vif [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86b17e61-f3fb-5ffe-8298-fdc487a5a85c', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb50c4378-46, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb50c4378-46, col_values=(('qos', UUID('920c81fa-f3ed-4e30-a9d6-7ac112de3038')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb50c4378-46, col_values=(('external_ids', {'iface-id': 'b50c4378-46f7-449b-8c0b-1c4082488139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:58:53', 'vm-uuid': 'f9569bc3-c6d4-4eb1-9a6f-73549952097f'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:50 user nova-compute[74739]: INFO os_vif [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:55:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No VIF found with MAC fa:16:3e:15:58:53, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-changed-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Refreshing instance network info cache due to event network-changed-894c2384-bea3-4cff-9111-d76b6c77de4e. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] Acquiring lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] Acquired lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Refreshing network info cache for port 894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updated VIF entry in instance network info cache for port b50c4378-46f7-449b-8c0b-1c4082488139. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.objects.instance [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1cad8ba3-c232-4d65-b6f7-251db20d28b7 req-40916724-2a2a-49f4-8d78-7775a8b23b8b service nova] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Ignoring supplied device name: /dev/vdb
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:51 user nova-compute[74739]: INFO nova.compute.manager [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Attaching volume 7577d067-ac41-47cd-9c3f-312de3b7b402 to /dev/vdb
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.utils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updated VIF entry in instance network info cache for port 894c2384-bea3-4cff-9111-d76b6c77de4e. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.network.neutron [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updating instance_info_cache with network_info: [{"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[83948893-417b-4a9d-ad1a-624f0c9e4308]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6589a24d-ca12-47ae-9b94-89c79a811bd6 req-b0e409a8-0fb8-4518-8cd5-2dc18f930bc1 service nova] Releasing lock "refresh_cache-4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[571cd61f-2ddf-4387-988e-57324f57142e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[792b869d-2a3e-42d3-8ea1-d3468d3691b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ac8642-a356-4528-afef-bf5bc704decd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:51 user nova-compute[74739]: WARNING nova.compute.manager [req-f3156d7e-a757-4207-871c-5f10ee829259 req-c9327ad9-563e-4d8f-854c-d601a319e291 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state active and task_state None.
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:55:51 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:55:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f91358-0cb9-447f-9d15-78563e4ea6e3]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG os_brick.utils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:55:51 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updating existing volume attachment record: 54c11e33-0d2f-4d01-a3e9-5409920fbaac {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:52 user nova-compute[74739]: WARNING nova.compute.manager [req-f2ea3224-307d-46e0-971c-34dddbcc5cbc req-69b3a8e5-8375-4d4a-b9f6-463b895bc493 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state building and task_state spawning.
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:55:54 user nova-compute[74739]: WARNING nova.compute.manager [req-a3a7baa3-f281-47c8-97cb-80a710b3a345 req-861ded15-61a8-4f17-b853-925896dffeae service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state building and task_state spawning.
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:55:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance spawned successfully.
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:55:55 user nova-compute[74739]: INFO nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Took 6.81 seconds to spawn the instance on the hypervisor.
Oct 25 17:55:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:55:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:55 user nova-compute[74739]: INFO nova.compute.manager [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Took 7.64 seconds to build instance.
Oct 25 17:55:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08706232-b052-4e0d-95e1-85af1df03dda tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.770s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:55:58 user nova-compute[74739]: INFO nova.compute.claims [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Claim successful on node user
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:55:59 user nova-compute[74739]: INFO nova.compute.claims [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Claim successful on node user
Oct 25 17:55:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.policy [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964d6de8a5b7400ea3a45d666a499632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed00ba170e845c8ad57fe410d8388b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:55:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Creating image(s)
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "/opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.247s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:55:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk 1073741824" returned: 0 in 0.079s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.819s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Successfully created port: ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:56:00 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.251s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.policy [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c88a22f5a64ecfbf4d00e1e01e836f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd857f6b59a4255b30b0449aef675c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:56:00 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Creating image(s)
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "/opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "/opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "/opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Cannot resize image /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Ensure instance console log exists: /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.227s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.222s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk 1073741824" returned: 0 in 0.054s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Successfully updated port: ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Successfully created port: 945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-changed-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Refreshing instance network info cache due to event network-changed-ca62fe2b-759a-4f35-bf61-fca1a4c586f9. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] Acquiring lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Cannot resize image /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Ensure instance console log exists: /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updating instance_info_cache with network_info: [{"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Instance network_info: |[{"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] Acquired lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Refreshing network info cache for port ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Start _get_guest_xml network_info=[{"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:56:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1513987037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1513987037',id=22,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-rjqmlw7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:56:00Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=90654bc3-128a-4c50-a106-e919cc201796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid 90654bc3-128a-4c50-a106-e919cc201796 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:56:02 user nova-compute[74739]:   <uuid>90654bc3-128a-4c50-a106-e919cc201796</uuid>
Oct 25 17:56:02 user nova-compute[74739]:   <name>instance-00000016</name>
Oct 25 17:56:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:56:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:56:02 user nova-compute[74739]:   <metadata>
Oct 25 17:56:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:56:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1513987037</nova:name>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:56:02</nova:creationTime>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:56:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:56:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:owner>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 17:56:02 user nova-compute[74739]:       </nova:owner>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:56:02 user nova-compute[74739]:       <nova:ports>
Oct 25 17:56:02 user nova-compute[74739]:         <nova:port uuid="ca62fe2b-759a-4f35-bf61-fca1a4c586f9">
Oct 25 17:56:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 17:56:02 user nova-compute[74739]:         </nova:port>
Oct 25 17:56:02 user nova-compute[74739]:       </nova:ports>
Oct 25 17:56:02 user nova-compute[74739]:     </nova:instance>
Oct 25 17:56:02 user nova-compute[74739]:   </metadata>
Oct 25 17:56:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:56:02 user nova-compute[74739]:     <system>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="serial">90654bc3-128a-4c50-a106-e919cc201796</entry>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="uuid">90654bc3-128a-4c50-a106-e919cc201796</entry>
Oct 25 17:56:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:56:02 user nova-compute[74739]:     </system>
Oct 25 17:56:02 user nova-compute[74739]:   </sysinfo>
Oct 25 17:56:02 user nova-compute[74739]:   <os>
Oct 25 17:56:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:56:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:56:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:56:02 user nova-compute[74739]:   </os>
Oct 25 17:56:02 user nova-compute[74739]:   <features>
Oct 25 17:56:02 user nova-compute[74739]:     <acpi/>
Oct 25 17:56:02 user nova-compute[74739]:     <apic/>
Oct 25 17:56:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:56:02 user nova-compute[74739]:   </features>
Oct 25 17:56:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:56:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:56:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:56:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:56:02 user nova-compute[74739]:   </clock>
Oct 25 17:56:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:56:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:56:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:56:02 user nova-compute[74739]:   </cpu>
Oct 25 17:56:02 user nova-compute[74739]:   <devices>
Oct 25 17:56:02 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:56:02 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:56:02 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk"/>
Oct 25 17:56:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:56:02 user nova-compute[74739]:     </disk>
Oct 25 17:56:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:56:02 user nova-compute[74739]:       <mac address="fa:16:3e:61:6a:11"/>
Oct 25 17:56:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:56:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:56:02 user nova-compute[74739]:       <target dev="tapca62fe2b-75"/>
Oct 25 17:56:02 user nova-compute[74739]:     </interface>
Oct 25 17:56:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:56:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/console.log" append="off"/>
Oct 25 17:56:02 user nova-compute[74739]:     </serial>
Oct 25 17:56:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:56:02 user nova-compute[74739]:     <video>
Oct 25 17:56:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:56:02 user nova-compute[74739]:     </video>
Oct 25 17:56:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:56:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:56:02 user nova-compute[74739]:     </rng>
Oct 25 17:56:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:56:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:56:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:56:02 user nova-compute[74739]:     </memballoon>
Oct 25 17:56:02 user nova-compute[74739]:   </devices>
Oct 25 17:56:02 user nova-compute[74739]: </domain>
Oct 25 17:56:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1513987037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1513987037',id=22,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-rjqmlw7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:56:00Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=90654bc3-128a-4c50-a106-e919cc201796,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG os_vif [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de864b55-4fcb-50a0-9b8e-e804ff49215e', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca62fe2b-75, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca62fe2b-75, col_values=(('qos', UUID('a8d24d91-3342-4602-b0c4-d51fd8558bd3')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca62fe2b-75, col_values=(('external_ids', {'iface-id': 'ca62fe2b-759a-4f35-bf61-fca1a4c586f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:6a:11', 'vm-uuid': '90654bc3-128a-4c50-a106-e919cc201796'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:02 user nova-compute[74739]: INFO os_vif [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75')
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:61:6a:11, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Successfully updated port: 945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:56:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updated VIF entry in instance network info cache for port ca62fe2b-759a-4f35-bf61-fca1a4c586f9. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updating instance_info_cache with network_info: [{"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquired lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5cee0bfa-96bf-467d-a155-5bcaf2899f72 req-6bccd346-3975-449b-aa75-51df5c517a37 service nova] Releasing lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Updating instance_info_cache with network_info: [{"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Releasing lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Instance network_info: |[{"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Start _get_guest_xml network_info=[{"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:56:03 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:03 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1310910717',display_name='tempest-VolumesAdminNegativeTest-server-1310910717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1310910717',id=23,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-m5abqtr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:56:01Z,user_data=None,user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=6beff309-1d3d-49a0-848b-90ecfe12e3c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'pci_devices' on Instance uuid 6beff309-1d3d-49a0-848b-90ecfe12e3c6 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:56:03 user nova-compute[74739]:   <uuid>6beff309-1d3d-49a0-848b-90ecfe12e3c6</uuid>
Oct 25 17:56:03 user nova-compute[74739]:   <name>instance-00000017</name>
Oct 25 17:56:03 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:56:03 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:56:03 user nova-compute[74739]:   <metadata>
Oct 25 17:56:03 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:56:03 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1310910717</nova:name>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:56:03</nova:creationTime>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:56:03 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:56:03 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:owner>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:user uuid="59c88a22f5a64ecfbf4d00e1e01e836f">tempest-VolumesAdminNegativeTest-1830493659-project-member</nova:user>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:project uuid="afd857f6b59a4255b30b0449aef675c0">tempest-VolumesAdminNegativeTest-1830493659</nova:project>
Oct 25 17:56:03 user nova-compute[74739]:       </nova:owner>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:56:03 user nova-compute[74739]:       <nova:ports>
Oct 25 17:56:03 user nova-compute[74739]:         <nova:port uuid="945397dc-356a-4055-a063-3f38f47d0239">
Oct 25 17:56:03 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 17:56:03 user nova-compute[74739]:         </nova:port>
Oct 25 17:56:03 user nova-compute[74739]:       </nova:ports>
Oct 25 17:56:03 user nova-compute[74739]:     </nova:instance>
Oct 25 17:56:03 user nova-compute[74739]:   </metadata>
Oct 25 17:56:03 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:56:03 user nova-compute[74739]:     <system>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="serial">6beff309-1d3d-49a0-848b-90ecfe12e3c6</entry>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="uuid">6beff309-1d3d-49a0-848b-90ecfe12e3c6</entry>
Oct 25 17:56:03 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:56:03 user nova-compute[74739]:     </system>
Oct 25 17:56:03 user nova-compute[74739]:   </sysinfo>
Oct 25 17:56:03 user nova-compute[74739]:   <os>
Oct 25 17:56:03 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:56:03 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:56:03 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:56:03 user nova-compute[74739]:   </os>
Oct 25 17:56:03 user nova-compute[74739]:   <features>
Oct 25 17:56:03 user nova-compute[74739]:     <acpi/>
Oct 25 17:56:03 user nova-compute[74739]:     <apic/>
Oct 25 17:56:03 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:56:03 user nova-compute[74739]:   </features>
Oct 25 17:56:03 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:56:03 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:56:03 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:56:03 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:56:03 user nova-compute[74739]:   </clock>
Oct 25 17:56:03 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:56:03 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:56:03 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:56:03 user nova-compute[74739]:   </cpu>
Oct 25 17:56:03 user nova-compute[74739]:   <devices>
Oct 25 17:56:03 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:56:03 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:56:03 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk"/>
Oct 25 17:56:03 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:56:03 user nova-compute[74739]:     </disk>
Oct 25 17:56:03 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:56:03 user nova-compute[74739]:       <mac address="fa:16:3e:a6:3c:f2"/>
Oct 25 17:56:03 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:56:03 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:56:03 user nova-compute[74739]:       <target dev="tap945397dc-35"/>
Oct 25 17:56:03 user nova-compute[74739]:     </interface>
Oct 25 17:56:03 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:56:03 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/console.log" append="off"/>
Oct 25 17:56:03 user nova-compute[74739]:     </serial>
Oct 25 17:56:03 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:56:03 user nova-compute[74739]:     <video>
Oct 25 17:56:03 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:56:03 user nova-compute[74739]:     </video>
Oct 25 17:56:03 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:56:03 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:56:03 user nova-compute[74739]:     </rng>
Oct 25 17:56:03 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:56:03 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:56:03 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:56:03 user nova-compute[74739]:     </memballoon>
Oct 25 17:56:03 user nova-compute[74739]:   </devices>
Oct 25 17:56:03 user nova-compute[74739]: </domain>
Oct 25 17:56:03 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1310910717',display_name='tempest-VolumesAdminNegativeTest-server-1310910717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1310910717',id=23,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-m5abqtr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:56:01Z,user_data=None,user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=6beff309-1d3d-49a0-848b-90ecfe12e3c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG os_vif [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd67a1f77-e249-54b4-a2d3-dce5a31add82', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap945397dc-35, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap945397dc-35, col_values=(('qos', UUID('2cf1567e-5501-42b9-aae4-bff6b2e37582')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap945397dc-35, col_values=(('external_ids', {'iface-id': '945397dc-356a-4055-a063-3f38f47d0239', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3c:f2', 'vm-uuid': '6beff309-1d3d-49a0-848b-90ecfe12e3c6'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: INFO os_vif [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35')
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] No VIF found with MAC fa:16:3e:a6:3c:f2, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-changed-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Refreshing instance network info cache due to event network-changed-945397dc-356a-4055-a063-3f38f47d0239. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] Acquiring lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] Acquired lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Refreshing network info cache for port 945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] No waiting events found dispatching network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:04 user nova-compute[74739]: WARNING nova.compute.manager [req-25aa87db-cf40-43e0-9dac-a6d0ed90898a req-99ac0166-ebe6-418c-8aa5-af99d5be386c service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received unexpected event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 for instance with vm_state building and task_state spawning.
Oct 25 17:56:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Updated VIF entry in instance network info cache for port 945397dc-356a-4055-a063-3f38f47d0239. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Updating instance_info_cache with network_info: [{"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bda8533c-8335-47e3-b7f6-a39a54099e8b req-80312fca-9121-4536-8834-a2cdcf85e248 service nova] Releasing lock "refresh_cache-6beff309-1d3d-49a0-848b-90ecfe12e3c6" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] No waiting events found dispatching network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:05 user nova-compute[74739]: WARNING nova.compute.manager [req-3fe1d991-481c-41ba-bb5d-8b7c39342390 req-2c95f632-3757-4b6b-8217-967fe75c1eaf service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received unexpected event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 for instance with vm_state building and task_state spawning.
Oct 25 17:56:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] No waiting events found dispatching network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:06 user nova-compute[74739]: WARNING nova.compute.manager [req-536faeb7-2168-40ab-9ea2-86db57c3050d req-aa18235f-ec5a-4ac6-aa82-b89e52020913 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received unexpected event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 for instance with vm_state building and task_state spawning.
Oct 25 17:56:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:56:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Instance spawned successfully.
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-changed-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Refreshing instance network info cache due to event network-changed-d824bc69-2605-4d52-a156-abae100ada96. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] Acquiring lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] Acquired lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.network.neutron [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Refreshing network info cache for port d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:56:07 user nova-compute[74739]: INFO nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Took 8.00 seconds to spawn the instance on the hypervisor.
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:56:07 user nova-compute[74739]: INFO nova.compute.manager [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Took 9.09 seconds to build instance.
Oct 25 17:56:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dce474f7-5cce-41a1-a5d1-e10ff3bbd518 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.236s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] No waiting events found dispatching network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:08 user nova-compute[74739]: WARNING nova.compute.manager [req-15148113-66fd-490a-bc14-5cdb5073a921 req-bfc6168c-1252-4f4e-af72-bf4c84767d5f service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received unexpected event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 for instance with vm_state building and task_state spawning.
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:56:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Instance spawned successfully.
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.network.neutron [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updated VIF entry in instance network info cache for port d824bc69-2605-4d52-a156-abae100ada96. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.network.neutron [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating instance_info_cache with network_info: [{"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-705e50f9-987b-40b5-af81-578eef457025 req-2eb443bd-8408-48b1-8c30-17f110794bd1 service nova] Releasing lock "refresh_cache-b29f69fa-c815-494c-80ca-fa26973a55c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:08 user nova-compute[74739]: INFO nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Took 7.50 seconds to spawn the instance on the hypervisor.
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:56:08 user nova-compute[74739]: INFO nova.compute.manager [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Took 8.86 seconds to build instance.
Oct 25 17:56:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1997d0f5-77a6-4e13-89d5-f72fdc876e9f tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.020s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [{"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5efeb2e-f9d5-42bc-a11f-397ab1f35823" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:09 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeOIxSrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:56:12 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:56:12 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:56:12 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa20e2c-3dae-46cf-82b2-cb77640539d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:56:12 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800042f-eaeb-47aa-8dd3-81a825d3eada]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402] added
Oct 25 17:56:12 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c5e9f5-2591-4ccd-aa16-00d8bf56c5f2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[668ff05e-95fd-4bc4-8e8f-ef56897961c3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeOIxSrE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WeOIxSrE" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ff545c-dc98-4d4b-b64b-62409c810e7e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WeOIxSrE'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf69da72-5969-42ac-a79e-0978dff1d540]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ebc073-a0f2-434e-9247-23bd06262e66]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c4496b-1c3c-4611-8777-a30dd62c824c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260]
Oct 25 17:56:13 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260] successful.
Oct 25 17:56:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec005b5-5f11-405c-97a8-59b6a5be1f9f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12bf0fd-baca-48c6-adca-7fb4a67b3981]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647b627-a7e6-404c-95a8-d62058695d59]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeOIxSrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26636326134613533', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636326134613533', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:56:14 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:56:14 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:56:14 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:56:14 user nova-compute[74739]:   <serial>7577d067-ac41-47cd-9c3f-312de3b7b402</serial>
Oct 25 17:56:14 user nova-compute[74739]: </disk>
Oct 25 17:56:14 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lazy-loading 'flavor' on Instance uuid b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:14 user nova-compute[74739]: INFO nova.compute.manager [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Attaching volume 48444d29-3f47-46af-a019-1a35a95c6640 to /dev/vdb
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:14 user nova-compute[74739]: INFO nova.compute.manager [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Terminating instance
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG os_brick.utils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef7b0b-c17b-4812-85bc-cfc91a3a0372]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] No VIF found with MAC fa:16:3e:5b:f5:db, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0bea9d-fd44-4b9b-a253-371db82a4aa9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48df82d-847b-4658-8a83-49a263503b3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-4b2a7710-1039-438b-b4d1-22f42511aba3 req-05dfba65-ab40-466b-a564-52e2fc0bb972 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-unplugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a83dfb-74ea-4c6d-9075-b9850dcda36a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:56:15 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:56:16 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab601ac6-c289-459e-a21d-6282928222d2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG os_brick.utils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] <== get_connector_properties: return (1248ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating existing volume attachment record: 98ebbc73-0a73-469b-99cf-4beb28ef391c {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Instance destroyed successfully.
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.objects.instance [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'resources' on Instance uuid c5efeb2e-f9d5-42bc-a11f-397ab1f35823 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.079524993896484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337550697',display_name='tempest-TestMinimumBasicScenario-server-337550697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337550697',id=12,image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYL11EdJn30HQL+k9CKe3JCyzOt9ngHxc6yABShiMdHXfvGhNFZNYCJaPlxs51Rc9kRnc5d8fmqB1NbWUdLhG9bjtgT2sFQY/K1+JupIYGPCLQ+wqfJ+d8xiKVDFhz0aw==',key_name='tempest-TestMinimumBasicScenario-1638792151',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:50:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-270yp20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6dce144c-d2cf-4a7e-996a-497cd0fa6c74',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:53:28Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=c5efeb2e-f9d5-42bc-a11f-397ab1f35823,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "address": "fa:16:3e:73:f5:2d", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff881ee6-94", "ovs_interfaceid": "ff881ee6-9485-4a9d-a60f-623bbf5169a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG os_vif [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff881ee6-94, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb9dbbfd-6c87-49cc-bb6e-d3a9c8600bb9) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:16 user nova-compute[74739]: INFO os_vif [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:f5:2d,bridge_name='br-int',has_traffic_filtering=True,id=ff881ee6-9485-4a9d-a60f-623bbf5169a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff881ee6-94')
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Deleting instance files /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823_del
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Deletion of /opt/stack/data/nova/instances/c5efeb2e-f9d5-42bc-a11f-397ab1f35823_del complete
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a19c8239-7e93-484c-b87c-f77e4e751119 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.659s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.compute.manager [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Took 1.53 seconds to destroy the instance on the hypervisor.
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b29f69fa-c815-494c-80ca-fa26973a55c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4425dd16-6194-48f7-8cd9-a956167c5cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 6beff309-1d3d-49a0-848b-90ecfe12e3c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-9cbb363e-c269-4cbb-ba37-c58e1f5cc238 req-e5e159d8-d8b8-494b-947e-72df8985df31 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-deleted-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.compute.manager [req-9cbb363e-c269-4cbb-ba37-c58e1f5cc238 req-e5e159d8-d8b8-494b-947e-72df8985df31 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Neutron deleted interface ff881ee6-9485-4a9d-a60f-623bbf5169a1; detaching it from the instance and deleting it from the info cache
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.network.neutron [req-9cbb363e-c269-4cbb-ba37-c58e1f5cc238 req-e5e159d8-d8b8-494b-947e-72df8985df31 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:56:16 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Took 0.58 seconds to deallocate network for instance.
Oct 25 17:56:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-9cbb363e-c269-4cbb-ba37-c58e1f5cc238 req-e5e159d8-d8b8-494b-947e-72df8985df31 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Detach interface failed, port_id=ff881ee6-9485-4a9d-a60f-623bbf5169a1, reason: Instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] Acquiring lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] No waiting events found dispatching network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:56:17 user nova-compute[74739]: WARNING nova.compute.manager [req-78ef51a0-75b7-4cd0-b7c8-c0ce42895aaf req-dabd2ed2-2233-4821-9c6f-ef57b8d12cf4 service nova] [instance: c5efeb2e-f9d5-42bc-a11f-397ab1f35823] Received unexpected event network-vif-plugged-ff881ee6-9485-4a9d-a60f-623bbf5169a1 for instance with vm_state deleted and task_state None.
Oct 25 17:56:17 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:56:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:17 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Deleted allocations for instance c5efeb2e-f9d5-42bc-a11f-397ab1f35823
Oct 25 17:56:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-0e46594f-7420-4cd6-8abe-dc8b282c4e6d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "c5efeb2e-f9d5-42bc-a11f-397ab1f35823" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWbcoyjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:56:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:56:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:56:34 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed5f4d9-ee07-495e-8bc1-e64208b9eed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:56:34 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8faed-6fbf-49f1-bd24-9e5626c621c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640] added
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba3317c-1e97-4c2f-a1b0-d4109f1d73dc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7956571a-6168-478d-9341-13fa5760603b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWbcoyjv {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gWbcoyjv" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78015dd-8846-43b6-8769-b5378e9a6ce1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gWbcoyjv'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fde69-9248-497d-8281-33f48cef73fb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9270a9-2603-4548-bbd1-3dc6c95b5799]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c6ec2-0656-4343-ad6d-c4ad92587d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260]
Oct 25 17:56:34 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260] successful.
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa6f26-23e7-4f25-94e9-807833acb7c3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[84537a01-5138-4253-8e14-e413ab70dd36]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d6fb4-ccd7-4c72-94bc-4709dba769f1]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:56:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWbcoyjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23433316562323062', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433316562323062', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lazy-loading 'flavor' on Instance uuid b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:56:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:56:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:56:35 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:56:35 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:56:35 user nova-compute[74739]:   <serial>48444d29-3f47-46af-a019-1a35a95c6640</serial>
Oct 25 17:56:35 user nova-compute[74739]: </disk>
Oct 25 17:56:35 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:56:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:56:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] No VIF found with MAC fa:16:3e:c4:95:22, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:56:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7643107-ddc3-45f3-947e-477715b0a612 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.889s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:56:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:56:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:56:39 user nova-compute[74739]: INFO nova.compute.manager [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Detaching volume 48444d29-3f47-46af-a019-1a35a95c6640
Oct 25 17:56:39 user nova-compute[74739]: INFO nova.virt.block_device [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Attempting to driver detach volume 48444d29-3f47-46af-a019-1a35a95c6640 from mountpoint /dev/vdb
Oct 25 17:56:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Attempting to detach device vdb from instance b29f69fa-c815-494c-80ca-fa26973a55c4 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:56:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:56:39 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:56:39 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:56:39 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:56:39 user nova-compute[74739]:   <serial>48444d29-3f47-46af-a019-1a35a95c6640</serial>
Oct 25 17:56:39 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:56:39 user nova-compute[74739]: </disk>
Oct 25 17:56:39 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:56:39 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Successfully detached device vdb from instance b29f69fa-c815-494c-80ca-fa26973a55c4 from the persistent domain config.
Oct 25 17:56:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b29f69fa-c815-494c-80ca-fa26973a55c4 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:56:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:56:39 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:56:39 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:56:39 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:56:39 user nova-compute[74739]:   <serial>48444d29-3f47-46af-a019-1a35a95c6640</serial>
Oct 25 17:56:39 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:56:39 user nova-compute[74739]: </disk>
Oct 25 17:56:39 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:56:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:56:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:59 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b29f69fa-c815-494c-80ca-fa26973a55c4 is timed out.
Oct 25 17:56:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Successfully detached device vdb from instance b29f69fa-c815-494c-80ca-fa26973a55c4 from the live domain config.
Oct 25 17:56:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gWbcoyjv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:56:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e97d06-794f-4fd7-8f95-c64109f7ccc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:56:59 user nova-compute[74739]: No targets found.
Oct 25 17:56:59 user nova-compute[74739]: iSNS:
Oct 25 17:56:59 user nova-compute[74739]: No targets found.
Oct 25 17:56:59 user nova-compute[74739]: STATIC:
Oct 25 17:56:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402
Oct 25 17:56:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:56:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:56:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640
Oct 25 17:56:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:56:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:56:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:56:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:56:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:56:59 user nova-compute[74739]: FIRMWARE:
Oct 25 17:56:59 user nova-compute[74739]: No targets found.
Oct 25 17:56:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:56:59 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:56:59 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80fc367-a75b-44b7-afa0-be8ff78fe317]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a45be1f-7ab5-4b38-9529-a6922231c543]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:56:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec2880d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824f9bc-9c4a-4b12-a359-33d727972e27]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae8d309-234c-4c36-82d0-4c9344f97333]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a36e4-ee6c-435f-85a7-aa6c6412b0f3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e4534-2b3b-407b-be3e-f362f1b67321]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7584fd3-8fe7-4356-81b8-44e6b9947a1d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:56:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d534c416-0223-4ed0-b162-7f5d0aa91632]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260]
Oct 25 17:57:00 user nova-compute[74739]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640, portal: 172.16.0.220,3260] successful.
Oct 25 17:57:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48444d29-3f47-46af-a019-1a35a95c6640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[417cec10-93e7-44a3-a91a-a2fb66df206a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] <== disconnect_volume: return (363ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lazy-loading 'flavor' on Instance uuid b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9fd1b750-7e34-442f-acd5-3fae636e561c tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.871s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:09 user nova-compute[74739]: INFO nova.compute.manager [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Detaching volume 7577d067-ac41-47cd-9c3f-312de3b7b402
Oct 25 17:57:09 user nova-compute[74739]: INFO nova.virt.block_device [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Attempting to driver detach volume 7577d067-ac41-47cd-9c3f-312de3b7b402 from mountpoint /dev/vdb
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Attempting to detach device vdb from instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:57:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:57:09 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:57:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:57:09 user nova-compute[74739]:   <serial>7577d067-ac41-47cd-9c3f-312de3b7b402</serial>
Oct 25 17:57:09 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:57:09 user nova-compute[74739]: </disk>
Oct 25 17:57:09 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully detached device vdb from instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 from the persistent domain config.
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 17:57:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:57:09 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:57:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:57:09 user nova-compute[74739]:   <serial>7577d067-ac41-47cd-9c3f-312de3b7b402</serial>
Oct 25 17:57:09 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 17:57:09 user nova-compute[74739]: </disk>
Oct 25 17:57:09 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:57:09 user nova-compute[74739]: INFO nova.compute.claims [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Claim successful on node user
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:57:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.policy [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c1ddab8fb434e49b076d09fc47ab457', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffa01a7434304fa29b2944261e223a3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:57:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Creating image(s)
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "/opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "/opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "/opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Successfully created port: ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.part --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG nova.virt.images [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] 26a8c333-05e1-493a-b2db-8edbb14a87b5 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.part /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.part /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.converted" returned: 0 in 0.412s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.284s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Successfully updated port: ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing instance network info cache due to event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c54c663-8d00-4fa1-9639-7c8af8c71064 req-dbe45ab2-3119-4258-b218-3d8a7e69480a service nova] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a,backing_fmt=raw /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a,backing_fmt=raw /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk 1073741824" returned: 0 in 0.076s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "a845e1d88f76ba88fbe8c575e654dfa7388ff59a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a --force-share --output=json" returned: 0 in 0.219s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Cannot resize image /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Ensure instance console log exists: /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance network_info: |[{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Start _get_guest_xml network_info=[{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:57:06Z,direct_url=<?>,disk_format='qcow2',id=26a8c333-05e1-493a-b2db-8edbb14a87b5,min_disk=0,min_ram=0,name='tempest-scenario-img--1820052466',owner='ffa01a7434304fa29b2944261e223a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '26a8c333-05e1-493a-b2db-8edbb14a87b5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:57:13 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:13 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:57:06Z,direct_url=<?>,disk_format='qcow2',id=26a8c333-05e1-493a-b2db-8edbb14a87b5,min_disk=0,min_ram=0,name='tempest-scenario-img--1820052466',owner='ffa01a7434304fa29b2944261e223a3a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1657899299',display_name='tempest-TestMinimumBasicScenario-server-1657899299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1657899299',id=24,image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsaQA/tBLLRcs3rA5n7445r2XYDfNUVFHOAvJLKB25iLPeqBLf+APn+vYxB9NRX92rQEvzLiYl4FWi0/InNnULHu3rLX186ZjERnW9pbOYy/0BqcyGMD7lX4waWRScPWw==',key_name='tempest-TestMinimumBasicScenario-490274427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-jdkwnl93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:11Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=df989d46-17b2-48b1-bff6-a826b63665d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.objects.instance [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'pci_devices' on Instance uuid df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:57:13 user nova-compute[74739]:   <uuid>df989d46-17b2-48b1-bff6-a826b63665d4</uuid>
Oct 25 17:57:13 user nova-compute[74739]:   <name>instance-00000018</name>
Oct 25 17:57:13 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:57:13 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:57:13 user nova-compute[74739]:   <metadata>
Oct 25 17:57:13 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:57:13 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:name>tempest-TestMinimumBasicScenario-server-1657899299</nova:name>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:57:13</nova:creationTime>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:57:13 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:57:13 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:owner>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:user uuid="6c1ddab8fb434e49b076d09fc47ab457">tempest-TestMinimumBasicScenario-265773077-project-member</nova:user>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:project uuid="ffa01a7434304fa29b2944261e223a3a">tempest-TestMinimumBasicScenario-265773077</nova:project>
Oct 25 17:57:13 user nova-compute[74739]:       </nova:owner>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:root type="image" uuid="26a8c333-05e1-493a-b2db-8edbb14a87b5"/>
Oct 25 17:57:13 user nova-compute[74739]:       <nova:ports>
Oct 25 17:57:13 user nova-compute[74739]:         <nova:port uuid="ac34d476-39cc-4090-b50a-5bc5f0e340a1">
Oct 25 17:57:13 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 17:57:13 user nova-compute[74739]:         </nova:port>
Oct 25 17:57:13 user nova-compute[74739]:       </nova:ports>
Oct 25 17:57:13 user nova-compute[74739]:     </nova:instance>
Oct 25 17:57:13 user nova-compute[74739]:   </metadata>
Oct 25 17:57:13 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:57:13 user nova-compute[74739]:     <system>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="serial">df989d46-17b2-48b1-bff6-a826b63665d4</entry>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="uuid">df989d46-17b2-48b1-bff6-a826b63665d4</entry>
Oct 25 17:57:13 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:57:13 user nova-compute[74739]:     </system>
Oct 25 17:57:13 user nova-compute[74739]:   </sysinfo>
Oct 25 17:57:13 user nova-compute[74739]:   <os>
Oct 25 17:57:13 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:57:13 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:57:13 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:57:13 user nova-compute[74739]:   </os>
Oct 25 17:57:13 user nova-compute[74739]:   <features>
Oct 25 17:57:13 user nova-compute[74739]:     <acpi/>
Oct 25 17:57:13 user nova-compute[74739]:     <apic/>
Oct 25 17:57:13 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:57:13 user nova-compute[74739]:   </features>
Oct 25 17:57:13 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:57:13 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:57:13 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:57:13 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:57:13 user nova-compute[74739]:   </clock>
Oct 25 17:57:13 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:57:13 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:57:13 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:57:13 user nova-compute[74739]:   </cpu>
Oct 25 17:57:13 user nova-compute[74739]:   <devices>
Oct 25 17:57:13 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:57:13 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:57:13 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk"/>
Oct 25 17:57:13 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:57:13 user nova-compute[74739]:     </disk>
Oct 25 17:57:13 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:57:13 user nova-compute[74739]:       <mac address="fa:16:3e:a4:60:38"/>
Oct 25 17:57:13 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:13 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:57:13 user nova-compute[74739]:       <target dev="tapac34d476-39"/>
Oct 25 17:57:13 user nova-compute[74739]:     </interface>
Oct 25 17:57:13 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:57:13 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/console.log" append="off"/>
Oct 25 17:57:13 user nova-compute[74739]:     </serial>
Oct 25 17:57:13 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:57:13 user nova-compute[74739]:     <video>
Oct 25 17:57:13 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:13 user nova-compute[74739]:     </video>
Oct 25 17:57:13 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:57:13 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:57:13 user nova-compute[74739]:     </rng>
Oct 25 17:57:13 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:57:13 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:57:13 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:57:13 user nova-compute[74739]:     </memballoon>
Oct 25 17:57:13 user nova-compute[74739]:   </devices>
Oct 25 17:57:13 user nova-compute[74739]: </domain>
Oct 25 17:57:13 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1657899299',display_name='tempest-TestMinimumBasicScenario-server-1657899299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1657899299',id=24,image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsaQA/tBLLRcs3rA5n7445r2XYDfNUVFHOAvJLKB25iLPeqBLf+APn+vYxB9NRX92rQEvzLiYl4FWi0/InNnULHu3rLX186ZjERnW9pbOYy/0BqcyGMD7lX4waWRScPWw==',key_name='tempest-TestMinimumBasicScenario-490274427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-jdkwnl93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:11Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=df989d46-17b2-48b1-bff6-a826b63665d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG os_vif [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a6d1884-9dd4-5f44-a262-dbbd75d0010b', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac34d476-39, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac34d476-39, col_values=(('qos', UUID('be61d5fd-94c2-479b-a236-4fd807c7ee83')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac34d476-39, col_values=(('external_ids', {'iface-id': 'ac34d476-39cc-4090-b50a-5bc5f0e340a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:60:38', 'vm-uuid': 'df989d46-17b2-48b1-bff6-a826b63665d4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:13 user nova-compute[74739]: INFO os_vif [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39')
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No VIF found with MAC fa:16:3e:a4:60:38, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:15 user nova-compute[74739]: WARNING nova.compute.manager [req-8665b918-6c12-4503-839a-bda4393177b5 req-13e6df90-1ddd-4f97-b725-93f18a655917 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state building and task_state spawning.
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.013690948486328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b29f69fa-c815-494c-80ca-fa26973a55c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4425dd16-6194-48f7-8cd9-a956167c5cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 6beff309-1d3d-49a0-848b-90ecfe12e3c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:57:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:17 user nova-compute[74739]: WARNING nova.compute.manager [req-d0b8343e-37ba-49d4-ab54-af851ef866fc req-e37d546b-1bcd-4e70-92f8-128bc0c14153 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state building and task_state spawning.
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:57:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance spawned successfully.
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:17 user nova-compute[74739]: INFO nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Took 6.60 seconds to spawn the instance on the hypervisor.
Oct 25 17:57:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:17 user nova-compute[74739]: INFO nova.compute.manager [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Took 7.60 seconds to build instance.
Oct 25 17:57:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-3c52f0dc-0930-4020-86f4-47323a8e277d tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.720s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:19 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:57:19 user nova-compute[74739]: INFO nova.compute.claims [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Claim successful on node user
Oct 25 17:57:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:57:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:57:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Creating image(s)
Oct 25 17:57:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "/opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "/opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "/opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.218s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk 1073741824" returned: 0 in 0.062s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG nova.policy [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09182444484b47109694929e255980f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c23fdb7343a4896b931d2d300c76872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Checking if we can resize image /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Cannot resize image /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Ensure instance console log exists: /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Successfully created port: 07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:57:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Successfully updated port: 07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquired lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-changed-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Refreshing instance network info cache due to event network-changed-07bcea2e-3726-4d5a-91c4-668ac06b2f94. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] Acquiring lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Updating instance_info_cache with network_info: [{"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Releasing lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Instance network_info: |[{"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] Acquired lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Refreshing network info cache for port 07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Start _get_guest_xml network_info=[{"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:57:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1656917128',display_name='tempest-VolumesNegativeTest-instance-1656917128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1656917128',id=25,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c23fdb7343a4896b931d2d300c76872',ramdisk_id='',reservation_id='r-sj5kyu4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-944740618',owner_user_name='tempest-VolumesNegativeTest-944740618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:21Z,user_data=None,user_id='09182444484b47109694929e255980f9',uuid=002666e9-756b-4891-b2b5-2929e0085000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converting VIF {"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lazy-loading 'pci_devices' on Instance uuid 002666e9-756b-4891-b2b5-2929e0085000 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:57:23 user nova-compute[74739]:   <uuid>002666e9-756b-4891-b2b5-2929e0085000</uuid>
Oct 25 17:57:23 user nova-compute[74739]:   <name>instance-00000019</name>
Oct 25 17:57:23 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:57:23 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:57:23 user nova-compute[74739]:   <metadata>
Oct 25 17:57:23 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:57:23 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:name>tempest-VolumesNegativeTest-instance-1656917128</nova:name>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:57:23</nova:creationTime>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:57:23 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:57:23 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:owner>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:user uuid="09182444484b47109694929e255980f9">tempest-VolumesNegativeTest-944740618-project-member</nova:user>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:project uuid="4c23fdb7343a4896b931d2d300c76872">tempest-VolumesNegativeTest-944740618</nova:project>
Oct 25 17:57:23 user nova-compute[74739]:       </nova:owner>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:57:23 user nova-compute[74739]:       <nova:ports>
Oct 25 17:57:23 user nova-compute[74739]:         <nova:port uuid="07bcea2e-3726-4d5a-91c4-668ac06b2f94">
Oct 25 17:57:23 user nova-compute[74739]:           <nova:ip type="fixed" address="192.168.233.53" ipVersion="4"/>
Oct 25 17:57:23 user nova-compute[74739]:         </nova:port>
Oct 25 17:57:23 user nova-compute[74739]:       </nova:ports>
Oct 25 17:57:23 user nova-compute[74739]:     </nova:instance>
Oct 25 17:57:23 user nova-compute[74739]:   </metadata>
Oct 25 17:57:23 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:57:23 user nova-compute[74739]:     <system>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="serial">002666e9-756b-4891-b2b5-2929e0085000</entry>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="uuid">002666e9-756b-4891-b2b5-2929e0085000</entry>
Oct 25 17:57:23 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:57:23 user nova-compute[74739]:     </system>
Oct 25 17:57:23 user nova-compute[74739]:   </sysinfo>
Oct 25 17:57:23 user nova-compute[74739]:   <os>
Oct 25 17:57:23 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:57:23 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:57:23 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:57:23 user nova-compute[74739]:   </os>
Oct 25 17:57:23 user nova-compute[74739]:   <features>
Oct 25 17:57:23 user nova-compute[74739]:     <acpi/>
Oct 25 17:57:23 user nova-compute[74739]:     <apic/>
Oct 25 17:57:23 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:57:23 user nova-compute[74739]:   </features>
Oct 25 17:57:23 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:57:23 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:57:23 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:57:23 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:57:23 user nova-compute[74739]:   </clock>
Oct 25 17:57:23 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:57:23 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:57:23 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:57:23 user nova-compute[74739]:   </cpu>
Oct 25 17:57:23 user nova-compute[74739]:   <devices>
Oct 25 17:57:23 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:57:23 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:57:23 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk"/>
Oct 25 17:57:23 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:57:23 user nova-compute[74739]:     </disk>
Oct 25 17:57:23 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:57:23 user nova-compute[74739]:       <mac address="fa:16:3e:95:11:7c"/>
Oct 25 17:57:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:23 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:57:23 user nova-compute[74739]:       <target dev="tap07bcea2e-37"/>
Oct 25 17:57:23 user nova-compute[74739]:     </interface>
Oct 25 17:57:23 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:57:23 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/console.log" append="off"/>
Oct 25 17:57:23 user nova-compute[74739]:     </serial>
Oct 25 17:57:23 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:57:23 user nova-compute[74739]:     <video>
Oct 25 17:57:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:23 user nova-compute[74739]:     </video>
Oct 25 17:57:23 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:57:23 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:57:23 user nova-compute[74739]:     </rng>
Oct 25 17:57:23 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:57:23 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:57:23 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:57:23 user nova-compute[74739]:     </memballoon>
Oct 25 17:57:23 user nova-compute[74739]:   </devices>
Oct 25 17:57:23 user nova-compute[74739]: </domain>
Oct 25 17:57:23 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1656917128',display_name='tempest-VolumesNegativeTest-instance-1656917128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1656917128',id=25,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c23fdb7343a4896b931d2d300c76872',ramdisk_id='',reservation_id='r-sj5kyu4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-944740618',owner_user_name='tempest-VolumesNegativeTest-944740618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:21Z,user_data=None,user_id='09182444484b47109694929e255980f9',uuid=002666e9-756b-4891-b2b5-2929e0085000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converting VIF {"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG os_vif [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edf31dab-39be-5f48-9d66-657e1c38c2e2', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07bcea2e-37, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07bcea2e-37, col_values=(('qos', UUID('360bbbe5-f3fd-49e0-83ef-4686c6edd734')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07bcea2e-37, col_values=(('external_ids', {'iface-id': '07bcea2e-3726-4d5a-91c4-668ac06b2f94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:11:7c', 'vm-uuid': '002666e9-756b-4891-b2b5-2929e0085000'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:23 user nova-compute[74739]: INFO os_vif [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37')
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] No VIF found with MAC fa:16:3e:95:11:7c, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Updated VIF entry in instance network info cache for port 07bcea2e-3726-4d5a-91c4-668ac06b2f94. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Updating instance_info_cache with network_info: [{"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74e35e85-1997-46ac-a941-ccba9ea85f23 req-ccfdee36-ca33-44d5-9aa0-2fd658156cd9 service nova] Releasing lock "refresh_cache-002666e9-756b-4891-b2b5-2929e0085000" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] No waiting events found dispatching network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:25 user nova-compute[74739]: WARNING nova.compute.manager [req-9c3c6916-bb66-4732-8ddc-cf245776328c req-d45883f3-f56c-4de0-ab84-1fc29a7a2b2e service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received unexpected event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 for instance with vm_state building and task_state spawning.
Oct 25 17:57:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:57:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Instance spawned successfully.
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:27 user nova-compute[74739]: INFO nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] No waiting events found dispatching network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:27 user nova-compute[74739]: WARNING nova.compute.manager [req-8f6df653-b9fd-4e5e-a9ae-cfc5e6221522 req-c7a02c8a-dd6e-4123-b905-057651ffb1ed service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received unexpected event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 for instance with vm_state building and task_state spawning.
Oct 25 17:57:27 user nova-compute[74739]: INFO nova.compute.manager [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Took 7.33 seconds to build instance.
Oct 25 17:57:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6ebb17b3-27f5-4766-868a-d46d37b44150 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:57:29 user nova-compute[74739]: INFO nova.compute.claims [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Claim successful on node user
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:57:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:57:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.policy [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05983a2b250c415eb66a51571da2facf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd34a9a90a764499bb3e666c8ef83fe22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:30 user nova-compute[74739]: INFO nova.virt.block_device [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Booting with volume e5d58217-3070-43c9-a028-2a6f26a07ef2 at /dev/vda
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c46753b-85d9-413f-b5c1-88af9cf4c368]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 is timed out.
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e045a-c2b8-4577-b5b4-8a44c1f7ccbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully detached device vdb from instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 from the live domain config.
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeOIxSrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:57:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da263aba-a164-4649-ac86-35acf7054fb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d7543-302c-4667-8a70-81792ff0dc24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f507968-41f9-46d0-9bae-e449c4ccc17d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:57:30 user nova-compute[74739]: No targets found.
Oct 25 17:57:30 user nova-compute[74739]: iSNS:
Oct 25 17:57:30 user nova-compute[74739]: No targets found.
Oct 25 17:57:30 user nova-compute[74739]: STATIC:
Oct 25 17:57:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402
Oct 25 17:57:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:57:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:57:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:57:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:57:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:57:30 user nova-compute[74739]: FIRMWARE:
Oct 25 17:57:30 user nova-compute[74739]: No targets found.
Oct 25 17:57:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:57:30 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:57:30 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:57:30 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe01f4-fa5a-4219-9e41-89ac8cc5f338]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating existing volume attachment record: 14427674-44d6-42eb-91b5-7897b2f74b47 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[06313967-ee96-4441-a7c4-6d79209df15b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ca20b-8b10-4e92-9914-ccdc98fb9cf4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:57:30 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 (non-flash)
Oct 25 17:57:30 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc319e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e5588-f476-4ec5-9afe-ee009928ed08]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fada6c-fe7d-4cd8-a9a0-d93d40092de8]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7977dfcc-47b4-4e98-a978-bddbb2add68b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b6bea-85cc-4a55-a6cd-a1d4dd7395fa]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e30333-b884-475e-b58a-fdc7c96dc61d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d338bf-d6db-432e-aa42-7ebb6aa72ab8]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260]
Oct 25 17:57:30 user nova-compute[74739]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402, portal: 172.16.0.220,3260] successful.
Oct 25 17:57:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf82a7-4333-4411-a488-674dbff53ae4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== disconnect_volume: return (486ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:57:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Successfully created port: f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'flavor' on Instance uuid 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ff7a4d77-3592-4abc-b83f-f913af5060a9 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.264s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.057s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:31 user nova-compute[74739]: INFO nova.compute.manager [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Terminating instance
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Successfully updated port: f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquired lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-changed-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Refreshing instance network info cache due to event network-changed-f02cc6e2-452d-4e40-87d1-6d8eaea24266. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] Acquiring lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-unplugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] No waiting events found dispatching network-vif-unplugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3065e31-8520-4263-a893-59af7410c610 req-08af2ea0-2d4d-41ed-b664-7b1d33105b05 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-unplugged-894c2384-bea3-4cff-9111-d76b6c77de4e for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating instance_info_cache with network_info: [{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Releasing lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance network_info: |[{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] Acquired lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Refreshing network info cache for port f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Instance destroyed successfully.
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lazy-loading 'resources' on Instance uuid 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1896820324',display_name='tempest-VolumesSnapshotTestJSON-instance-1896820324',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1896820324',id=18,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRpee8cgyjGJcx1/YTIkADRoVpRFrpTuQzbnR8R2mJqD/t6U3/pt+CEcAzQqOo2PopdHr5qNE2VuJ32Dzy2gQA0ERVJ7ms/Y7sxZqRxaEOkX8esVM41bhwvBgAub7dyVg==',key_name='tempest-keypair-251855502',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d58fc42ec534beb8c2e756b6f7edc3d',ramdisk_id='',reservation_id='r-o62e5dj5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1623722059',owner_user_name='tempest-VolumesSnapshotTestJSON-1623722059-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f9c0d42d1a402c8c17d32a328dd67f',uuid=4ea9932d-a6ac-4e0b-84fb-c3feab248ed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converting VIF {"id": "894c2384-bea3-4cff-9111-d76b6c77de4e", "address": "fa:16:3e:5b:f5:db", "network": {"id": "f02a568d-c62a-41f4-bc4d-9b53a5c78d81", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1884323443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d58fc42ec534beb8c2e756b6f7edc3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap894c2384-be", "ovs_interfaceid": "894c2384-bea3-4cff-9111-d76b6c77de4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_vif [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap894c2384-be, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3c86b33-3967-473f-b6d9-16999475d42d) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:32 user nova-compute[74739]: INFO os_vif [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:f5:db,bridge_name='br-int',has_traffic_filtering=True,id=894c2384-bea3-4cff-9111-d76b6c77de4e,network=Network(f02a568d-c62a-41f4-bc4d-9b53a5c78d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap894c2384-be')
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WeOIxSrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:57:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b797bdce-a6cf-435d-b2ef-2b22da87d459]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:57:32 user nova-compute[74739]: No targets found.
Oct 25 17:57:32 user nova-compute[74739]: iSNS:
Oct 25 17:57:32 user nova-compute[74739]: No targets found.
Oct 25 17:57:32 user nova-compute[74739]: STATIC:
Oct 25 17:57:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:57:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:57:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:57:32 user nova-compute[74739]: FIRMWARE:
Oct 25 17:57:32 user nova-compute[74739]: No targets found.
Oct 25 17:57:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:57:32 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:57:32 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7577d067-ac41-47cd-9c3f-312de3b7b402', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[98381347-1999-4fb8-813f-1dfbb75020e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f35e7-3f59-4b20-b004-1fd67ab8299b]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec1777f0>, {}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Disconnecting from: [] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] <== disconnect_volume: return (82ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:57:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Deleting instance files /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1_del
Oct 25 17:57:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Deletion of /opt/stack/data/nova/instances/4ea9932d-a6ac-4e0b-84fb-c3feab248ed1_del complete
Oct 25 17:57:32 user nova-compute[74739]: INFO nova.compute.manager [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updated VIF entry in instance network info cache for port f02cc6e2-452d-4e40-87d1-6d8eaea24266. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating instance_info_cache with network_info: [{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f4b735db-eeca-4cd9-abff-7a81d9b927fd req-13f2e38d-daa2-45f2-a434-47903f489d93 service nova] Releasing lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:33 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Took 1.14 seconds to deallocate network for instance.
Oct 25 17:57:33 user nova-compute[74739]: WARNING nova.volume.cinder [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Attachment 54c11e33-0d2f-4d01-a3e9-5409920fbaac does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 54c11e33-0d2f-4d01-a3e9-5409920fbaac. (HTTP 404) (Request-ID: req-6b755422-8d86-42ba-9edb-f1f9b435f3f2)
Oct 25 17:57:33 user nova-compute[74739]: INFO nova.compute.manager [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Took 0.02 seconds to detach 1 volumes for instance.
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-269136bd-cf42-456c-a8ee-d7aa84563051 req-3dad4e98-2253-4291-a851-9b924d2cfde0 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-deleted-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] Acquiring lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] No waiting events found dispatching network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:34 user nova-compute[74739]: WARNING nova.compute.manager [req-eaff3b64-f963-4893-a01d-ab3da51ba65e req-28901afe-f89e-4b9c-899d-d009f18d0593 service nova] [instance: 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1] Received unexpected event network-vif-plugged-894c2384-bea3-4cff-9111-d76b6c77de4e for instance with vm_state deleted and task_state None.
Oct 25 17:57:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:34 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Deleted allocations for instance 4ea9932d-a6ac-4e0b-84fb-c3feab248ed1
Oct 25 17:57:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-48cfd46b-bbf5-4ab4-922f-c76444ac62f3 tempest-VolumesSnapshotTestJSON-1623722059 tempest-VolumesSnapshotTestJSON-1623722059-project-member] Lock "4ea9932d-a6ac-4e0b-84fb-c3feab248ed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.911s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing instance network info cache due to event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updated VIF entry in instance network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6ddf880-b7c6-4cc3-9b8b-5f16a4527174 req-a3ad6fde-af01-4ad7-8db2-8c170d6b2283 service nova] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-changed-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Refreshing instance network info cache due to event network-changed-b50c4378-46f7-449b-8c0b-1c4082488139. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Refreshing network info cache for port b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:39 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updated VIF entry in instance network info cache for port b50c4378-46f7-449b-8c0b-1c4082488139. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:57:39 user nova-compute[74739]: DEBUG nova.network.neutron [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3c6bdcb4-0852-4dc0-966e-825148735f56 req-76bc4453-2332-490c-95f0-6ff03f87149b service nova] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:40 user nova-compute[74739]: INFO nova.compute.manager [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Terminating instance
Oct 25 17:57:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-unplugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] No waiting events found dispatching network-vif-unplugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-47057bc9-f2ac-40f0-b3c5-588b89caaa51 req-878085ee-848c-443d-aa75-eabadde3ccb0 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-unplugged-d824bc69-2605-4d52-a156-abae100ada96 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Instance destroyed successfully.
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.objects.instance [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lazy-loading 'resources' on Instance uuid b29f69fa-c815-494c-80ca-fa26973a55c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1221556862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1221556',id=19,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoMDXsKaKf8pJnVDNUBJl0dz+3mQHcVjVwyM0lM3UEK8pOdIjZrcsW2o5L2hPmeDG81TdE4a1f7sRfshic6tiaMryBtjvVXR/nW0QW3ZGuL+7bb1R76PHVNKPhUgEhH4A==',key_name='tempest-keypair-756652932',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e07a2c34ca0f4b5c9ef15cc25c341952',ramdisk_id='',reservation_id='r-p8dldu06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f1fa0911cff4b7fbbb4ba5096ef7969',uuid=b29f69fa-c815-494c-80ca-fa26973a55c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converting VIF {"id": "d824bc69-2605-4d52-a156-abae100ada96", "address": "fa:16:3e:c4:95:22", "network": {"id": "38660d93-7f66-4cdb-959c-02dad6dd1184", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1607677572-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e07a2c34ca0f4b5c9ef15cc25c341952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd824bc69-26", "ovs_interfaceid": "d824bc69-2605-4d52-a156-abae100ada96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG os_vif [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd824bc69-26, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a3b65e4-f191-479e-8d27-b9177d1728f2) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:41 user nova-compute[74739]: INFO os_vif [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:95:22,bridge_name='br-int',has_traffic_filtering=True,id=d824bc69-2605-4d52-a156-abae100ada96,network=Network(38660d93-7f66-4cdb-959c-02dad6dd1184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd824bc69-26')
Oct 25 17:57:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Deleting instance files /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4_del
Oct 25 17:57:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Deletion of /opt/stack/data/nova/instances/b29f69fa-c815-494c-80ca-fa26973a55c4_del complete
Oct 25 17:57:41 user nova-compute[74739]: INFO nova.compute.manager [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 17:57:41 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:57:41 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.compute.manager [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Shelving
Oct 25 17:57:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Took 1.07 seconds to deallocate network for instance.
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-3978167b-1a0b-43a7-a51d-a2c602480775 req-141ed2a3-de1b-4175-9993-1d5618482a5d service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-deleted-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.compute.manager [req-3978167b-1a0b-43a7-a51d-a2c602480775 req-141ed2a3-de1b-4175-9993-1d5618482a5d service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Neutron deleted interface d824bc69-2605-4d52-a156-abae100ada96; detaching it from the instance and deleting it from the info cache
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-3978167b-1a0b-43a7-a51d-a2c602480775 req-141ed2a3-de1b-4175-9993-1d5618482a5d service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-3978167b-1a0b-43a7-a51d-a2c602480775 req-141ed2a3-de1b-4175-9993-1d5618482a5d service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Detach interface failed, port_id=d824bc69-2605-4d52-a156-abae100ada96, reason: Instance b29f69fa-c815-494c-80ca-fa26973a55c4 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:42 user nova-compute[74739]: WARNING nova.compute.manager [req-72acc44c-f2a2-4983-84a3-882b5bb454e2 req-ae3d6752-b299-4590-9779-5f5e81072c12 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state active and task_state shelving.
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] Acquiring lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] No waiting events found dispatching network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:42 user nova-compute[74739]: WARNING nova.compute.manager [req-1aa7e5c4-8568-4ecc-bbea-c6896a9815cb req-ab3d2b33-fa69-4a1a-b5b0-abdc29823817 service nova] [instance: b29f69fa-c815-494c-80ca-fa26973a55c4] Received unexpected event network-vif-plugged-d824bc69-2605-4d52-a156-abae100ada96 for instance with vm_state deleted and task_state None.
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance destroyed successfully.
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Beginning cold snapshot process
Oct 25 17:57:42 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Deleted allocations for instance b29f69fa-c815-494c-80ca-fa26973a55c4
Oct 25 17:57:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-079b1ae4-7f8b-4162-bf5c-367b6aa68669 tempest-TestServerVolumeAttachScenarioOldVersion-329944953 tempest-TestServerVolumeAttachScenarioOldVersion-329944953-project-member] Lock "b29f69fa-c815-494c-80ca-fa26973a55c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.797s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:43 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:57:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk /opt/stack/data/nova/instances/snapshots/tmp_ww01d8c/e759b72fc0084586bb3582f5c713d93c {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk /opt/stack/data/nova/instances/snapshots/tmp_ww01d8c/e759b72fc0084586bb3582f5c713d93c" returned: 0 in 0.843s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Snapshot extracted, beginning image upload
Oct 25 17:57:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:44 user nova-compute[74739]: WARNING nova.compute.manager [req-40c0406c-92d8-4bea-a3f8-c3e7fbb4af48 req-900151ac-4f4b-4fd7-bd2a-8197a82ac996 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state active and task_state shelving_image_uploading.
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:45 user nova-compute[74739]: INFO nova.compute.manager [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Attaching volume 6d801d48-7ffd-4afe-abaf-4917ea91a87b to /dev/vdb
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.utils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6394de5d-e5de-41a8-9b37-28952d4d5800]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57bfa9b-95c1-4b29-8b9e-de2ac9d08e76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8645e6-7965-4a35-b15a-71f0a369130a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fae431c-f198-42c6-8ff8-3491e85877d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:57:45 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:57:45 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[72285478-dd49-4a0f-aa57-d69186b62982]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG os_brick.utils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:45 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating existing volume attachment record: c81805b1-80e0-4adf-9625-9570d69ea03e {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:57:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Snapshot image upload complete
Oct 25 17:57:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:47 user nova-compute[74739]: INFO nova.compute.manager [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Shelve offloading
Oct 25 17:57:47 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance destroyed successfully.
Oct 25 17:57:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:57:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance destroyed successfully.
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'resources' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf5ADe13sKGNtLF+nRidm4gdmMPSRnreZfu75U2a81p4V/dbYBYxySzqYKBQuDuc8XbXPVuioircPq9BYkWt1NPUViQnfi/UF5Ld/kW8Z87VY6dy6sPk5Ba5xD4mZ50HA==',key_name='tempest-keypair-1385679357',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:57:46.954617',shelved_host='user',shelved_image_id='16678ead-18b1-4eba-9e32-c21f8bc6ec54'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG os_vif [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9eb48b-a5, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b7fbc5f-2a01-4bc2-9860-a6ba1990ea74) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing instance network info cache due to event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:48 user nova-compute[74739]: INFO os_vif [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5')
Oct 25 17:57:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Deleting instance files /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4_del
Oct 25 17:57:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Deletion of /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4_del complete
Oct 25 17:57:48 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Deleted allocations for instance 4425dd16-6194-48f7-8cd9-a956167c5cc4
Oct 25 17:57:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'numa_topology' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:48 user nova-compute[74739]: DEBUG nova.objects.base [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<4425dd16-6194-48f7-8cd9-a956167c5cc4> lazy-loaded attributes: resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG nova.network.neutron [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updated VIF entry in instance network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG nova.network.neutron [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-db944b6a-0d93-4dca-b79e-2d34a2757587 req-5f8b124d-5d8f-4ec3-8e7b-da2b8b3d9960 service nova] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1c420fb0-416e-430c-acbc-9d5345721b0e tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.243s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:49 user nova-compute[74739]: INFO nova.compute.manager [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] instance snapshotting
Oct 25 17:57:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Beginning live snapshot process
Oct 25 17:57:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:57:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Creating image(s)
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start _get_guest_xml network_info=[{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '14427674-44d6-42eb-91b5-7897b2f74b47', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3723e87f-01ff-4e0a-aea0-21cbda1530c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5d58217-3070-43c9-a028-2a6f26a07ef2', 'serial': 'e5d58217-3070-43c9-a028-2a6f26a07ef2'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:57:50 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:57:50 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:57:50 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[612bc8a5-9b2c-4a0f-94f0-3b37b21eb198]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:57:50 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cad1e6-ece9-4560-ad90-79a37253fa35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2] added
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7e7eb3-1421-44af-a929-8b751a95fb2e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3599e5-ea5b-4205-b593-f3aa4952875c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHSATLpM {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHSATLpM" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac31ff-9d3a-4893-b990-c6efa9ab5424]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHSATLpM'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab2332-45e3-4fd3-ad59-954055d2d3c4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c6b5e-f279-4197-bd6a-61ff4a22d128]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff.delta 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf51f22e-0132-448c-a114-e280a85de3da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]
Oct 25 17:57:50 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff.delta 1073741824" returned: 0 in 0.056s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae45a0e-a77b-4265-84e8-35ddb8773d87]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc205d8-5544-447b-867d-697660425ae7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:57:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6926167d-4bd2-4512-9e86-ea534962f4f8]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:57:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26130373262346536', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:57:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130373262346536', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1540939192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lazy-loading 'pci_devices' on Instance uuid 3723e87f-01ff-4e0a-aea0-21cbda1530c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:57:52 user nova-compute[74739]:   <uuid>3723e87f-01ff-4e0a-aea0-21cbda1530c4</uuid>
Oct 25 17:57:52 user nova-compute[74739]:   <name>instance-0000001a</name>
Oct 25 17:57:52 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:57:52 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:57:52 user nova-compute[74739]:   <metadata>
Oct 25 17:57:52 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:57:52 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:57:52 user nova-compute[74739]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1540939192</nova:name>
Oct 25 17:57:52 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:57:50</nova:creationTime>
Oct 25 17:57:52 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:57:52 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:57:52 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:57:52 user nova-compute[74739]:       <nova:owner>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:user uuid="05983a2b250c415eb66a51571da2facf">tempest-ServerActionsV293TestJSON-580492283-project-member</nova:user>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:project uuid="d34a9a90a764499bb3e666c8ef83fe22">tempest-ServerActionsV293TestJSON-580492283</nova:project>
Oct 25 17:57:52 user nova-compute[74739]:       </nova:owner>
Oct 25 17:57:52 user nova-compute[74739]:       <nova:ports>
Oct 25 17:57:52 user nova-compute[74739]:         <nova:port uuid="f02cc6e2-452d-4e40-87d1-6d8eaea24266">
Oct 25 17:57:52 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 17:57:52 user nova-compute[74739]:         </nova:port>
Oct 25 17:57:52 user nova-compute[74739]:       </nova:ports>
Oct 25 17:57:52 user nova-compute[74739]:     </nova:instance>
Oct 25 17:57:52 user nova-compute[74739]:   </metadata>
Oct 25 17:57:52 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:57:52 user nova-compute[74739]:     <system>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="serial">3723e87f-01ff-4e0a-aea0-21cbda1530c4</entry>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="uuid">3723e87f-01ff-4e0a-aea0-21cbda1530c4</entry>
Oct 25 17:57:52 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:57:52 user nova-compute[74739]:     </system>
Oct 25 17:57:52 user nova-compute[74739]:   </sysinfo>
Oct 25 17:57:52 user nova-compute[74739]:   <os>
Oct 25 17:57:52 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:57:52 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:57:52 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:57:52 user nova-compute[74739]:   </os>
Oct 25 17:57:52 user nova-compute[74739]:   <features>
Oct 25 17:57:52 user nova-compute[74739]:     <acpi/>
Oct 25 17:57:52 user nova-compute[74739]:     <apic/>
Oct 25 17:57:52 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:57:52 user nova-compute[74739]:   </features>
Oct 25 17:57:52 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:57:52 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:57:52 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:57:52 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:57:52 user nova-compute[74739]:   </clock>
Oct 25 17:57:52 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:57:52 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:57:52 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:57:52 user nova-compute[74739]:   </cpu>
Oct 25 17:57:52 user nova-compute[74739]:   <devices>
Oct 25 17:57:52 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:57:52 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:57:52 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 17:57:52 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:57:52 user nova-compute[74739]:       <serial>e5d58217-3070-43c9-a028-2a6f26a07ef2</serial>
Oct 25 17:57:52 user nova-compute[74739]:     </disk>
Oct 25 17:57:52 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:57:52 user nova-compute[74739]:       <mac address="fa:16:3e:df:41:8b"/>
Oct 25 17:57:52 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:52 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:57:52 user nova-compute[74739]:       <target dev="tapf02cc6e2-45"/>
Oct 25 17:57:52 user nova-compute[74739]:     </interface>
Oct 25 17:57:52 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:57:52 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4/console.log" append="off"/>
Oct 25 17:57:52 user nova-compute[74739]:     </serial>
Oct 25 17:57:52 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:57:52 user nova-compute[74739]:     <video>
Oct 25 17:57:52 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:57:52 user nova-compute[74739]:     </video>
Oct 25 17:57:52 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:57:52 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:57:52 user nova-compute[74739]:     </rng>
Oct 25 17:57:52 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:57:52 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:57:52 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:57:52 user nova-compute[74739]:     </memballoon>
Oct 25 17:57:52 user nova-compute[74739]:   </devices>
Oct 25 17:57:52 user nova-compute[74739]: </domain>
Oct 25 17:57:52 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1540939192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:57:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG os_vif [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b30680ca-08b8-5d97-a9b0-0578c1b09391', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf02cc6e2-45, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf02cc6e2-45, col_values=(('qos', UUID('6ffa71d0-f0ac-40d9-8442-1672067d7db3')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf02cc6e2-45, col_values=(('external_ids', {'iface-id': 'f02cc6e2-452d-4e40-87d1-6d8eaea24266', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:41:8b', 'vm-uuid': '3723e87f-01ff-4e0a-aea0-21cbda1530c4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:52 user nova-compute[74739]: INFO os_vif [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45')
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] No VIF found with MAC fa:16:3e:df:41:8b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 17:57:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 17:57:52 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff.delta /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:57:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff.delta /opt/stack/data/nova/instances/snapshots/tmp8htjntjm/b0bf2fb352aa4dfca3b6243cc9fc50ff" returned: 0 in 0.248s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:57:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Snapshot extracted, beginning image upload
Oct 25 17:57:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:53 user nova-compute[74739]: WARNING nova.compute.manager [req-480fc5cd-976f-4cf6-b50b-cc00ef88a24f req-43495545-39e2-478e-85ce-5a6bb7606d50 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state building and task_state spawning.
Oct 25 17:57:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:57:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Snapshot image upload complete
Oct 25 17:57:55 user nova-compute[74739]: INFO nova.compute.manager [None req-7d012c1e-64bb-41c8-b963-3a47d725d57d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Took 5.71 seconds to snapshot the instance on the hypervisor.
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:57:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance spawned successfully.
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:57:55 user nova-compute[74739]: WARNING nova.compute.manager [req-62c2b0bf-70da-4a93-88c5-9826ff860b74 req-0c4b1e1f-7780-44a1-8191-9bb8fe837c05 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state building and task_state spawning.
Oct 25 17:57:55 user nova-compute[74739]: INFO nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 25 17:57:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:57:55 user nova-compute[74739]: INFO nova.compute.manager [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Took 26.70 seconds to build instance.
Oct 25 17:57:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1882fe4d-3164-4ec0-8b37-42e209e6b332 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.812s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:57:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:58:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:58:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:58:04 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09382b1-b08d-4d67-8e18-2fed75138b59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:58:04 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca753f35-bf5c-4319-9cee-ee9f768754e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b] added
Oct 25 17:58:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb3388-682d-4e3b-a8ef-fd3a145b14fe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b2b01-8422-4510-978b-b186c43f36ca]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLTkRVi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLTkRVi" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a7657-b9ef-4bde-8d0b-5af72b402ca9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMLTkRVi'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d11141-5fdd-4279-9c42-c1dca7d8f6f8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba1fb8-b2ff-42e5-a768-b30c8c45d1d7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b61081-bde1-468c-a525-201fdacb26ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]
Oct 25 17:58:05 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.
Oct 25 17:58:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f32303-74aa-430c-8f0c-642e492f10ee]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee522da9-9dc0-4caf-a572-bdbb42590ce2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:58:05 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:58:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8de20fe-3365-4ee3-b5d0-d69cde32c0ad]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:58:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23735646637363630', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646637363630', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:58:06 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:58:06 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 17:58:06 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:58:06 user nova-compute[74739]:   <serial>6d801d48-7ffd-4afe-abaf-4917ea91a87b</serial>
Oct 25 17:58:06 user nova-compute[74739]: </disk>
Oct 25 17:58:06 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:06 user nova-compute[74739]: INFO nova.compute.manager [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Terminating instance
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No VIF found with MAC fa:16:3e:15:58:53, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-unplugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] No waiting events found dispatching network-vif-unplugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-7c09f410-ad60-483c-a9da-b3161b13eda6 req-5db8db4a-2210-49bc-9286-ba17451569ae service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-unplugged-945397dc-356a-4055-a063-3f38f47d0239 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ad556f5d-9f20-4d2b-a522-f563f3a3d087 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.429s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 1 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 17:58:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deletion of /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize failed
Oct 25 17:58:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Instance destroyed successfully.
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'resources' on Instance uuid 6beff309-1d3d-49a0-848b-90ecfe12e3c6 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1310910717',display_name='tempest-VolumesAdminNegativeTest-server-1310910717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1310910717',id=23,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-m5abqtr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:56:08Z,user_data=None,user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=6beff309-1d3d-49a0-848b-90ecfe12e3c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "945397dc-356a-4055-a063-3f38f47d0239", "address": "fa:16:3e:a6:3c:f2", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap945397dc-35", "ovs_interfaceid": "945397dc-356a-4055-a063-3f38f47d0239", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG os_vif [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap945397dc-35, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2cf1567e-5501-42b9-aae4-bff6b2e37582) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:58:07 user nova-compute[74739]: INFO os_vif [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3c:f2,bridge_name='br-int',has_traffic_filtering=True,id=945397dc-356a-4055-a063-3f38f47d0239,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap945397dc-35')
Oct 25 17:58:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Deleting instance files /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6_del
Oct 25 17:58:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Deletion of /opt/stack/data/nova/instances/6beff309-1d3d-49a0-848b-90ecfe12e3c6_del complete
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74739) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:58:07 user nova-compute[74739]: INFO nova.compute.manager [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:58:07 user nova-compute[74739]: WARNING nova.compute.manager [req-69c20f75-1d07-4364-99d0-929b2e4bbe34 req-935266bb-abb7-4a2a-b16f-24585fe97d1c service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state active and task_state powering-off.
Oct 25 17:58:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:58:08 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Took 0.70 seconds to deallocate network for instance.
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance destroyed successfully.
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f7f4ff3d-7495-405d-955e-c911c64a669f tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.905s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:08 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Deleted allocations for instance 6beff309-1d3d-49a0-848b-90ecfe12e3c6
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-26d97ca6-b6da-452c-9f62-12ad343b150a tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] Acquiring lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] Lock "6beff309-1d3d-49a0-848b-90ecfe12e3c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] No waiting events found dispatching network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:58:08 user nova-compute[74739]: WARNING nova.compute.manager [req-d99f2ab4-16a3-4b49-8318-d13c1b85268c req-0431b851-1d3e-4385-95ad-ba758d1e6028 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received unexpected event network-vif-plugged-945397dc-356a-4055-a063-3f38f47d0239 for instance with vm_state deleted and task_state None.
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] [instance: 6beff309-1d3d-49a0-848b-90ecfe12e3c6] Received event network-vif-deleted-945397dc-356a-4055-a063-3f38f47d0239 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:58:09 user nova-compute[74739]: WARNING nova.compute.manager [req-30adfbbf-d45d-41e2-b33e-5ba9c544d30b req-cb4287ff-7dee-43c4-8236-dac31eae9a44 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state stopped and task_state None.
Oct 25 17:58:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:58:10 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 17:58:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updating instance_info_cache with network_info: [{"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:58:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-08290f01-eee3-48ee-b4a0-1d976346f139" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:58:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:12 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:58:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:58:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:58:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=24.948833465576172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 02425b58-f6d0-49f6-bb07-b17608560557 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 002666e9-756b-4891-b2b5-2929e0085000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.692s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:58:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 17:58:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:58:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:58:57 user nova-compute[74739]: INFO nova.compute.claims [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Claim successful on node user
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 17:58:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 17:58:58 user nova-compute[74739]: DEBUG nova.policy [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964d6de8a5b7400ea3a45d666a499632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed00ba170e845c8ad57fe410d8388b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 17:58:58 user nova-compute[74739]: INFO nova.virt.block_device [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Booting with volume-backed-image fa4bc56a-56a0-4e07-993a-3918bd5a9269 at /dev/vda
Oct 25 17:58:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Successfully created port: 457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Successfully updated port: 457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-changed-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Refreshing instance network info cache due to event network-changed-457f798c-592f-43b3-b337-5ff9e88f23c9. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:58:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] Acquiring lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance network_info: |[{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] Acquired lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Refreshing network info cache for port 457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updated VIF entry in instance network info cache for port 457f798c-592f-43b3-b337-5ff9e88f23c9. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1bbaa97f-5a74-433d-8273-94833160f958 req-3421bb63-6342-4109-8edf-44706d2f998c service nova] Releasing lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:06 user nova-compute[74739]: INFO nova.compute.manager [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Terminating instance
Oct 25 17:59:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:06 user nova-compute[74739]: INFO nova.compute.manager [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Attaching volume 13c475e6-2753-4712-8617-bab64e53aa75 to /dev/vdb
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.utils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[482773f4-b1a3-492c-a6e9-38326c08ff40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[250ec6df-afa6-468c-8bda-9f94cd1f73e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[74869a53-1937-46a1-8dc2-b238298b0d85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac7191-28e4-469a-bf07-2f44c44be384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:07 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d837ded-1c20-4fdb-9e17-1e9f1c5e4111]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_brick.utils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating existing volume attachment record: 534da538-e77f-46d3-92bf-9e7f910ec3ec {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-unplugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] No waiting events found dispatching network-vif-unplugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-b36a8ba0-f14c-495f-b2a3-e965b8beaf72 req-17c6a549-61e7-4388-9fef-bd6b8de21261 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-unplugged-728bb0b9-cfcf-4876-b97b-02109cd837da for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Instance destroyed successfully.
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lazy-loading 'resources' on Instance uuid 02425b58-f6d0-49f6-bb07-b17608560557 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:52:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1850451263',display_name='tempest-VolumesAdminNegativeTest-server-1850451263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1850451263',id=16,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIoB4dyasREWrS4wKusYeqm5Qz8Jy+5wPEkzIQdflH1L+u+IWao1RPoHl38CbALMfqLeBDE36AlUkQ2Vj82frRS4TrhChUitrma84DX1cTPnuFp6diNYP8p6uTnvfzWA==',key_name='tempest-keypair-1607306597',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afd857f6b59a4255b30b0449aef675c0',ramdisk_id='',reservation_id='r-ozo71di3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1830493659',owner_user_name='tempest-VolumesAdminNegativeTest-1830493659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c88a22f5a64ecfbf4d00e1e01e836f',uuid=02425b58-f6d0-49f6-bb07-b17608560557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converting VIF {"id": "728bb0b9-cfcf-4876-b97b-02109cd837da", "address": "fa:16:3e:dd:0e:84", "network": {"id": "2b2343b7-6ce7-4452-9f99-2f1415440e5a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-613939547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afd857f6b59a4255b30b0449aef675c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728bb0b9-cf", "ovs_interfaceid": "728bb0b9-cfcf-4876-b97b-02109cd837da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG os_vif [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728bb0b9-cf, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9933396e-3384-4233-9124-5af2e8740360) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:07 user nova-compute[74739]: INFO os_vif [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:0e:84,bridge_name='br-int',has_traffic_filtering=True,id=728bb0b9-cfcf-4876-b97b-02109cd837da,network=Network(2b2343b7-6ce7-4452-9f99-2f1415440e5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728bb0b9-cf')
Oct 25 17:59:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Deleting instance files /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557_del
Oct 25 17:59:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Deletion of /opt/stack/data/nova/instances/02425b58-f6d0-49f6-bb07-b17608560557_del complete
Oct 25 17:59:07 user nova-compute[74739]: INFO nova.compute.manager [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 25 17:59:07 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:59:07 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:08 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Took 0.66 seconds to deallocate network for instance.
Oct 25 17:59:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:59:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:09 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Deleted allocations for instance 02425b58-f6d0-49f6-bb07-b17608560557
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-267431b3-36ef-4552-9c0b-3a26cca0b61c tempest-VolumesAdminNegativeTest-1830493659 tempest-VolumesAdminNegativeTest-1830493659-project-member] Lock "02425b58-f6d0-49f6-bb07-b17608560557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.427s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] Acquiring lock "02425b58-f6d0-49f6-bb07-b17608560557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] Lock "02425b58-f6d0-49f6-bb07-b17608560557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] No waiting events found dispatching network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:09 user nova-compute[74739]: WARNING nova.compute.manager [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received unexpected event network-vif-plugged-728bb0b9-cfcf-4876-b97b-02109cd837da for instance with vm_state deleted and task_state None.
Oct 25 17:59:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-856f4b4d-c5cb-4a43-970e-f2fe6326e85b req-757803e2-c076-4175-a67b-cac0a748b656 service nova] [instance: 02425b58-f6d0-49f6-bb07-b17608560557] Received event network-vif-deleted-728bb0b9-cfcf-4876-b97b-02109cd837da {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:09 user nova-compute[74739]: INFO nova.compute.manager [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Terminating instance
Oct 25 17:59:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Instance destroyed successfully.
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lazy-loading 'resources' on Instance uuid 002666e9-756b-4891-b2b5-2929e0085000 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1656917128',display_name='tempest-VolumesNegativeTest-instance-1656917128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1656917128',id=25,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c23fdb7343a4896b931d2d300c76872',ramdisk_id='',reservation_id='r-sj5kyu4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-944740618',owner_user_name='tempest-VolumesNegativeTest-944740618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:57:27Z,user_data=None,user_id='09182444484b47109694929e255980f9',uuid=002666e9-756b-4891-b2b5-2929e0085000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converting VIF {"id": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "address": "fa:16:3e:95:11:7c", "network": {"id": "387d28ad-cb40-4eab-b010-1b697a1ed304", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bbb779392b5447ff8f25fe3cc1ea4af2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07bcea2e-37", "ovs_interfaceid": "07bcea2e-3726-4d5a-91c4-668ac06b2f94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG os_vif [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07bcea2e-37, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=360bbbe5-f3fd-49e0-83ef-4686c6edd734) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:10 user nova-compute[74739]: INFO os_vif [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:11:7c,bridge_name='br-int',has_traffic_filtering=True,id=07bcea2e-3726-4d5a-91c4-668ac06b2f94,network=Network(387d28ad-cb40-4eab-b010-1b697a1ed304),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07bcea2e-37')
Oct 25 17:59:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Deleting instance files /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000_del
Oct 25 17:59:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Deletion of /opt/stack/data/nova/instances/002666e9-756b-4891-b2b5-2929e0085000_del complete
Oct 25 17:59:10 user nova-compute[74739]: INFO nova.compute.manager [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 25 17:59:10 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-unplugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] No waiting events found dispatching network-vif-unplugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-unplugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Acquiring lock "002666e9-756b-4891-b2b5-2929e0085000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] Lock "002666e9-756b-4891-b2b5-2929e0085000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] No waiting events found dispatching network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:11 user nova-compute[74739]: WARNING nova.compute.manager [req-5bb39125-2f60-4cfb-bd30-8c5d88875e31 req-303270eb-2f14-4b2f-987e-7c3b64a78935 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received unexpected event network-vif-plugged-07bcea2e-3726-4d5a-91c4-668ac06b2f94 for instance with vm_state active and task_state deleting.
Oct 25 17:59:11 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Took 0.49 seconds to deallocate network for instance.
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:11 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Deleted allocations for instance 002666e9-756b-4891-b2b5-2929e0085000
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-765f9dae-fdcd-4180-99b8-8ce7c9bd33c4 tempest-VolumesNegativeTest-944740618 tempest-VolumesNegativeTest-944740618-project-member] Lock "002666e9-756b-4891-b2b5-2929e0085000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-12c98840-7463-44d6-820f-a81e3d3af045 req-ccda8127-fb5e-4aed-8490-c9b66f6d41e0 service nova] [instance: 002666e9-756b-4891-b2b5-2929e0085000] Received event network-vif-deleted-07bcea2e-3726-4d5a-91c4-668ac06b2f94 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.utils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c210ca32-771b-4785-b54a-49b85cd92e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[042cf1ec-b789-4196-a6cf-bf3d482c1d17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[719be2b2-4e30-4266-a2c4-496ab22e2e09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797805c-2659-43d9-bc64-dac686260643]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:14 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f58690-49b1-4a71-9769-7f4a5b0ea76d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG os_brick.utils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating existing volume attachment record: 27bde004-a16e-452f-b6b4-93328885bafc {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 17:59:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:16 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=25.00118637084961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 08290f01-eee3-48ee-b4a0-1d976346f139 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 17:59:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-changed-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Refreshing instance network info cache due to event network-changed-f02cc6e2-452d-4e40-87d1-6d8eaea24266. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] Acquiring lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] Acquired lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Refreshing network info cache for port f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updated VIF entry in instance network info cache for port f02cc6e2-452d-4e40-87d1-6d8eaea24266. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG nova.network.neutron [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating instance_info_cache with network_info: [{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a6aa5fa6-0f63-4719-a991-3c1b5533d95a req-5835ddc4-704f-472a-a4d0-d4db7a3dd530 service nova] Releasing lock "refresh_cache-3723e87f-01ff-4e0a-aea0-21cbda1530c4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:21 user nova-compute[74739]: INFO nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Rebuilding instance
Oct 25 17:59:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:59:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance destroyed successfully.
Oct 25 17:59:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance destroyed successfully.
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1101093121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf02cc6e2-45, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ffa71d0-f0ac-40d9-8442-1672067d7db3) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:22 user nova-compute[74739]: WARNING nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state active and task_state rebuilding.
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:22 user nova-compute[74739]: WARNING nova.compute.manager [req-09e0edf8-feee-4ec9-ac43-b6149911a252 req-bdf09536-4d52-4057-93ae-471c9243b039 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state active and task_state rebuilding.
Oct 25 17:59:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:22 user nova-compute[74739]: INFO os_vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45')
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:22 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5ec42-0d24-4509-8812-bed24a875d57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]: iSNS:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]: STATIC:
Oct 25 17:59:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2
Oct 25 17:59:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 17:59:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:59:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:22 user nova-compute[74739]: FIRMWARE:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:59:22 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:59:22 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0723ebd-4ae3-468b-a5b6-b855dd4893e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed1b2bf-e52a-408c-8f4b-649e8ebb04e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc247010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398e18f-a428-4853-be59-f776d633f678]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5a40c-54ce-49a1-9deb-573c942ee565]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fce597-0413-429f-bb57-635a80977f1e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[188014e6-dad5-44da-b0a8-a244ec54608e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fd1744-1d7a-428a-85fc-b65e89e8f863]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad6016-72b8-4155-90c4-b01c830b4d5e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]
Oct 25 17:59:22 user nova-compute[74739]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[48511d0d-5f76-40d0-b3eb-e0829cd39b83]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== disconnect_volume: return (329ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:59:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deleting instance files /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4_del
Oct 25 17:59:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deletion of /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4_del complete
Oct 25 17:59:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4 could not be found.
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:22 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09174fa5-5ed3-471a-925f-65fc8d6527d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]: iSNS:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]: STATIC:
Oct 25 17:59:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 17:59:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:59:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:22 user nova-compute[74739]: FIRMWARE:
Oct 25 17:59:22 user nova-compute[74739]: No targets found.
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:59:22 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:59:22 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38ebdad-fa79-499a-bac1-abc500881a21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e32a5b-48c0-4219-8cfc-016e68bb8e70]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:22 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc2440d0>, {}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Disconnecting from: [] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== disconnect_volume: return (76ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:59:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Preparing to wait for external event volume-reimaged-e5d58217-3070-43c9-a028-2a6f26a07ef2 {{(pid=74739) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 25 17:59:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctgIOesE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:26 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:26 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:26 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325ea8d-6255-4b0d-bd5d-cd03ff404e1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:59:26 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a745f-2a7f-4c4b-848b-887f3d59a4e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75] added
Oct 25 17:59:26 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d0aa53-bb96-479f-839d-a8e8d3fc229d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a567d9-1de7-4621-89c2-b0c5e367a39b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctgIOesE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ctgIOesE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfca959-ab91-4934-b867-0a99c1718a3f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ctgIOesE'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6373aad-3848-453b-be1b-2eb57b845817]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b76a74-a341-4a4c-8838-1700292af778]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:26 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:26 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:26 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:26 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eac9304-665f-4f60-aff2-df2fcbbe19af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260]
Oct 25 17:59:26 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260] successful.
Oct 25 17:59:26 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08b85f-9930-4647-9ed5-76851cae02c4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[419d0b8d-0837-4c3b-a69d-8114162e6acd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:27 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:27 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:27 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:27 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:27 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:27 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b148355d-30de-4551-8540-1d2cba899bcf]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctgIOesE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:59:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26431363866666263', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431363866666263', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.objects.instance [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 17:59:28 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:59:28 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 17:59:28 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 17:59:28 user nova-compute[74739]:   <serial>13c475e6-2753-4712-8617-bab64e53aa75</serial>
Oct 25 17:59:28 user nova-compute[74739]: </disk>
Oct 25 17:59:28 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] No VIF found with MAC fa:16:3e:a4:60:38, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:59:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-54efbe79-8f28-44fb-bb34-5531b7cce603 tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.832s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing instance network info cache due to event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updated VIF entry in instance network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1ec53ee0-7e06-4242-bb67-3d8f75488ed0 req-8db11706-3e69-476e-8c00-fa47b65080fe service nova] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing instance network info cache due to event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:59:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Creating image(s)
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Ensure instance console log exists: /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start _get_guest_xml network_info=[{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '27bde004-a16e-452f-b6b4-93328885bafc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eff7760a-3bdd-4322-bb7d-8bd9ad669a14', 'attached_at': '', 'detached_at': '', 'volume_id': '4d9364d8-b977-44ef-9823-a50224b6e511', 'serial': '4d9364d8-b977-44ef-9823-a50224b6e511'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:59:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:34 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c6b3fc-58ad-43c8-bda8-3c1ac8e03632]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 17:59:34 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347cc46-0f83-42de-9b8b-57d242f1ec6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511] added
Oct 25 17:59:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185e507-2a0d-45b1-83dd-015c2f161b95]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85fbf6-0cba-4fcf-9c3e-6affa16ffdd1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKQUTbmO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKQUTbmO" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0e7fa-fe6e-4a1c-90f0-8f7c5cb451b3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKQUTbmO'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3c9f4-d1a1-4ea7-b226-9fcac1b1cb20]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b88a1f-ec84-4fc1-9a6a-413262f48fed]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[681e153c-4794-4412-9864-7aee6bd62710]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260]
Oct 25 17:59:35 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260] successful.
Oct 25 17:59:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3afbf2-960d-4b1b-b7f6-a7b5471c41ef]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:35 user nova-compute[74739]: INFO nova.compute.manager [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Rebooting instance
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updated VIF entry in instance network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eb6d4c-5744-4f48-b77b-194930489bd5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d5e3d06d-316d-46d1-8835-a2460348d86c req-8fad32e0-c92d-43de-82a6-44c23c097cec service nova] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b46dea5-bbc4-41e0-972c-5a236698e42e]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:35 user nova-compute[74739]: INFO nova.compute.manager [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Unshelving
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_requests' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'numa_topology' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 17:59:35 user nova-compute[74739]: INFO nova.compute.claims [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Claim successful on node user
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 17:59:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:35 user nova-compute[74739]: INFO nova.network.neutron [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating port 6e9eb48b-a500-4a34-b011-fc2342c2b2de with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23166666139376132', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166666139376132', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-207586830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-207586830',id=27,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-jxg9a0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:58:59Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=eff7760a-3bdd-4322-bb7d-8bd9ad669a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.objects.instance [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:59:36 user nova-compute[74739]:   <uuid>eff7760a-3bdd-4322-bb7d-8bd9ad669a14</uuid>
Oct 25 17:59:36 user nova-compute[74739]:   <name>instance-0000001b</name>
Oct 25 17:59:36 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:59:36 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:59:36 user nova-compute[74739]:   <metadata>
Oct 25 17:59:36 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:59:36 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-207586830</nova:name>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:59:34</nova:creationTime>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:59:36 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:59:36 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:owner>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 17:59:36 user nova-compute[74739]:       </nova:owner>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 17:59:36 user nova-compute[74739]:       <nova:ports>
Oct 25 17:59:36 user nova-compute[74739]:         <nova:port uuid="457f798c-592f-43b3-b337-5ff9e88f23c9">
Oct 25 17:59:36 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 17:59:36 user nova-compute[74739]:         </nova:port>
Oct 25 17:59:36 user nova-compute[74739]:       </nova:ports>
Oct 25 17:59:36 user nova-compute[74739]:     </nova:instance>
Oct 25 17:59:36 user nova-compute[74739]:   </metadata>
Oct 25 17:59:36 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:59:36 user nova-compute[74739]:     <system>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="serial">eff7760a-3bdd-4322-bb7d-8bd9ad669a14</entry>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="uuid">eff7760a-3bdd-4322-bb7d-8bd9ad669a14</entry>
Oct 25 17:59:36 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:59:36 user nova-compute[74739]:     </system>
Oct 25 17:59:36 user nova-compute[74739]:   </sysinfo>
Oct 25 17:59:36 user nova-compute[74739]:   <os>
Oct 25 17:59:36 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:59:36 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:59:36 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:59:36 user nova-compute[74739]:   </os>
Oct 25 17:59:36 user nova-compute[74739]:   <features>
Oct 25 17:59:36 user nova-compute[74739]:     <acpi/>
Oct 25 17:59:36 user nova-compute[74739]:     <apic/>
Oct 25 17:59:36 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:59:36 user nova-compute[74739]:   </features>
Oct 25 17:59:36 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:59:36 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:59:36 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:59:36 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:59:36 user nova-compute[74739]:   </clock>
Oct 25 17:59:36 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:59:36 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:59:36 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:59:36 user nova-compute[74739]:   </cpu>
Oct 25 17:59:36 user nova-compute[74739]:   <devices>
Oct 25 17:59:36 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 17:59:36 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 17:59:36 user nova-compute[74739]:       <source dev="/dev/sde"/>
Oct 25 17:59:36 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:59:36 user nova-compute[74739]:       <serial>4d9364d8-b977-44ef-9823-a50224b6e511</serial>
Oct 25 17:59:36 user nova-compute[74739]:     </disk>
Oct 25 17:59:36 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:59:36 user nova-compute[74739]:       <mac address="fa:16:3e:ed:29:95"/>
Oct 25 17:59:36 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:59:36 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:59:36 user nova-compute[74739]:       <target dev="tap457f798c-59"/>
Oct 25 17:59:36 user nova-compute[74739]:     </interface>
Oct 25 17:59:36 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:59:36 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/console.log" append="off"/>
Oct 25 17:59:36 user nova-compute[74739]:     </serial>
Oct 25 17:59:36 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:59:36 user nova-compute[74739]:     <video>
Oct 25 17:59:36 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:59:36 user nova-compute[74739]:     </video>
Oct 25 17:59:36 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:59:36 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:59:36 user nova-compute[74739]:     </rng>
Oct 25 17:59:36 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:59:36 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:59:36 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:59:36 user nova-compute[74739]:     </memballoon>
Oct 25 17:59:36 user nova-compute[74739]:   </devices>
Oct 25 17:59:36 user nova-compute[74739]: </domain>
Oct 25 17:59:36 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-207586830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-207586830',id=27,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-jxg9a0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:58:59Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=eff7760a-3bdd-4322-bb7d-8bd9ad669a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG os_vif [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bb8f4f8-0b9e-5d09-be3f-9f123c425213', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap457f798c-59, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap457f798c-59, col_values=(('qos', UUID('ccbdf74d-8cd1-494d-91a7-a92011439ec3')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap457f798c-59, col_values=(('external_ids', {'iface-id': '457f798c-592f-43b3-b337-5ff9e88f23c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:29:95', 'vm-uuid': 'eff7760a-3bdd-4322-bb7d-8bd9ad669a14'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:36 user nova-compute[74739]: INFO os_vif [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59')
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:ed:29:95, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing instance network info cache due to event network-changed-6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 17:59:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] Acquiring lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 17:59:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Creating image(s)
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] Acquired lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Refreshing network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG nova.objects.base [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<4425dd16-6194-48f7-8cd9-a956167c5cc4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:38 user nova-compute[74739]: WARNING nova.compute.manager [req-df334821-3158-4e4b-bb68-f45c532036df req-fd42d2ca-a9b5-4ef0-a4b9-d928c4cbdef9 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state building and task_state spawning.
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.virt.images [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] 16678ead-18b1-4eba-9e32-c21f8bc6ec54 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.part /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updated VIF entry in instance network info cache for port 6e9eb48b-a500-4a34-b011-fc2342c2b2de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-943087e4-a2b6-4347-ab23-4bee4b4b80e1 req-6a327501-38b9-4e5f-a4ee-2d1dca416c6e service nova] Releasing lock "refresh_cache-4425dd16-6194-48f7-8cd9-a956167c5cc4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.part /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.converted" returned: 0 in 0.314s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:38 user nova-compute[74739]: WARNING nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state active and task_state reboot_started.
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:38 user nova-compute[74739]: WARNING nova.compute.manager [req-4a71078d-b179-4485-9c3a-a0849e407aa1 req-0644095b-44d4-4507-ac4a-ba553924ecba service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state active and task_state reboot_started.
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.785s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:39 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance shutdown successfully.
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json" returned: 0 in 0.266s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6,backing_fmt=raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6,backing_fmt=raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk 1073741824" returned: 0 in 0.049s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "84becd47b1a6c7fe667dcf41d96c90e38f5831f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'migration_context' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG nova.objects.base [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<4425dd16-6194-48f7-8cd9-a956167c5cc4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:39 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Rebasing disk image.
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 -F raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:40 user nova-compute[74739]: WARNING nova.compute.manager [req-fef52594-a21c-4847-a1cf-2c0917024993 req-d1a90795-4bcf-4164-9c67-465be89680dc service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state building and task_state spawning.
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:59:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance spawned successfully.
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:40 user nova-compute[74739]: INFO nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Took 5.55 seconds to spawn the instance on the hypervisor.
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:59:40 user nova-compute[74739]: INFO nova.compute.manager [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Took 42.47 seconds to build instance.
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-837862cc-da5e-4848-bafd-2ae69d814543 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.573s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:40 user nova-compute[74739]: WARNING nova.compute.manager [req-b4b35dbc-574b-497d-81cc-971704fbb2fe req-4a5ecb9d-62bf-4e41-b85d-5f07d642d5fe service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state active and task_state reboot_started.
Oct 25 17:59:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 -F raw /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk" returned: 0 in 2.589s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Ensure instance console log exists: /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start _get_guest_xml network_info=[{"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='af92bbf890255965530e3bf19ac97e11',container_format='bare',created_at=2023-10-25T17:57:42Z,direct_url=<?>,disk_format='qcow2',id=16678ead-18b1-4eba-9e32-c21f8bc6ec54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1908865262-shelved',owner='6c2a1dd2b0954a74be154b7082170334',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T17:57:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:59:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='af92bbf890255965530e3bf19ac97e11',container_format='bare',created_at=2023-10-25T17:57:42Z,direct_url=<?>,disk_format='qcow2',id=16678ead-18b1-4eba-9e32-c21f8bc6ec54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1908865262-shelved',owner='6c2a1dd2b0954a74be154b7082170334',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T17:57:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.objects.base [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<4425dd16-6194-48f7-8cd9-a956167c5cc4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='16678ead-18b1-4eba-9e32-c21f8bc6ec54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1385679357',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:57:46.954617',shelved_host='user',shelved_image_id='16678ead-18b1-4eba-9e32-c21f8bc6ec54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'pci_devices' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.objects.base [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Object Instance<4425dd16-6194-48f7-8cd9-a956167c5cc4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 17:59:42 user nova-compute[74739]:   <uuid>4425dd16-6194-48f7-8cd9-a956167c5cc4</uuid>
Oct 25 17:59:42 user nova-compute[74739]:   <name>instance-00000014</name>
Oct 25 17:59:42 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 17:59:42 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 17:59:42 user nova-compute[74739]:   <metadata>
Oct 25 17:59:42 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 17:59:42 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1908865262</nova:name>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:59:42</nova:creationTime>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 17:59:42 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 17:59:42 user nova-compute[74739]:       </nova:flavor>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:owner>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:user uuid="e140ed4e3e2f4d5abc2e08e1400715de">tempest-AttachVolumeShelveTestJSON-744521439-project-member</nova:user>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:project uuid="6c2a1dd2b0954a74be154b7082170334">tempest-AttachVolumeShelveTestJSON-744521439</nova:project>
Oct 25 17:59:42 user nova-compute[74739]:       </nova:owner>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:root type="image" uuid="16678ead-18b1-4eba-9e32-c21f8bc6ec54"/>
Oct 25 17:59:42 user nova-compute[74739]:       <nova:ports>
Oct 25 17:59:42 user nova-compute[74739]:         <nova:port uuid="6e9eb48b-a500-4a34-b011-fc2342c2b2de">
Oct 25 17:59:42 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 17:59:42 user nova-compute[74739]:         </nova:port>
Oct 25 17:59:42 user nova-compute[74739]:       </nova:ports>
Oct 25 17:59:42 user nova-compute[74739]:     </nova:instance>
Oct 25 17:59:42 user nova-compute[74739]:   </metadata>
Oct 25 17:59:42 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 17:59:42 user nova-compute[74739]:     <system>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="serial">4425dd16-6194-48f7-8cd9-a956167c5cc4</entry>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="uuid">4425dd16-6194-48f7-8cd9-a956167c5cc4</entry>
Oct 25 17:59:42 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 17:59:42 user nova-compute[74739]:     </system>
Oct 25 17:59:42 user nova-compute[74739]:   </sysinfo>
Oct 25 17:59:42 user nova-compute[74739]:   <os>
Oct 25 17:59:42 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 17:59:42 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 17:59:42 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 17:59:42 user nova-compute[74739]:   </os>
Oct 25 17:59:42 user nova-compute[74739]:   <features>
Oct 25 17:59:42 user nova-compute[74739]:     <acpi/>
Oct 25 17:59:42 user nova-compute[74739]:     <apic/>
Oct 25 17:59:42 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 17:59:42 user nova-compute[74739]:   </features>
Oct 25 17:59:42 user nova-compute[74739]:   <clock offset="utc">
Oct 25 17:59:42 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 17:59:42 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 17:59:42 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 17:59:42 user nova-compute[74739]:   </clock>
Oct 25 17:59:42 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 17:59:42 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 17:59:42 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 17:59:42 user nova-compute[74739]:   </cpu>
Oct 25 17:59:42 user nova-compute[74739]:   <devices>
Oct 25 17:59:42 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 17:59:42 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 17:59:42 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk"/>
Oct 25 17:59:42 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 17:59:42 user nova-compute[74739]:     </disk>
Oct 25 17:59:42 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 17:59:42 user nova-compute[74739]:       <mac address="fa:16:3e:b9:2f:6e"/>
Oct 25 17:59:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:59:42 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 17:59:42 user nova-compute[74739]:       <target dev="tap6e9eb48b-a5"/>
Oct 25 17:59:42 user nova-compute[74739]:     </interface>
Oct 25 17:59:42 user nova-compute[74739]:     <serial type="pty">
Oct 25 17:59:42 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/console.log" append="off"/>
Oct 25 17:59:42 user nova-compute[74739]:     </serial>
Oct 25 17:59:42 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 17:59:42 user nova-compute[74739]:     <video>
Oct 25 17:59:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 17:59:42 user nova-compute[74739]:     </video>
Oct 25 17:59:42 user nova-compute[74739]:     <rng model="virtio">
Oct 25 17:59:42 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 17:59:42 user nova-compute[74739]:     </rng>
Oct 25 17:59:42 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 17:59:42 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 17:59:42 user nova-compute[74739]:       <stats period="10"/>
Oct 25 17:59:42 user nova-compute[74739]:     </memballoon>
Oct 25 17:59:42 user nova-compute[74739]:   </devices>
Oct 25 17:59:42 user nova-compute[74739]: </domain>
Oct 25 17:59:42 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='16678ead-18b1-4eba-9e32-c21f8bc6ec54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1385679357',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member',shelved_at='2023-10-25T17:57:46.954617',shelved_host='user',shelved_image_id='16678ead-18b1-4eba-9e32-c21f8bc6ec54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG os_vif [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18ddc989-9e1e-5625-b894-19df3bc727a0', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e9eb48b-a5, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e9eb48b-a5, col_values=(('qos', UUID('0f2c3d79-af04-41df-887d-6c5399918c9b')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e9eb48b-a5, col_values=(('external_ids', {'iface-id': '6e9eb48b-a500-4a34-b011-fc2342c2b2de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:2f:6e', 'vm-uuid': '4425dd16-6194-48f7-8cd9-a956167c5cc4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:42 user nova-compute[74739]: INFO os_vif [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5')
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 17:59:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] No VIF found with MAC fa:16:3e:b9:2f:6e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:43 user nova-compute[74739]: WARNING nova.compute.manager [req-9feffea3-f2fb-472b-a6b6-70e27032b0cb req-f4d33f2f-e66c-4e40-9c56-d6b6f2e03d1f service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state active and task_state reboot_started.
Oct 25 17:59:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance running successfully.
Oct 25 17:59:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance soft rebooted successfully.
Oct 25 17:59:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:59:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-615c57b4-f851-4652-b157-1ab04934c5fa tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.429s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:44 user nova-compute[74739]: WARNING nova.compute.manager [req-6353916c-11b6-41a2-9313-19f4d1bfe3d6 req-94984591-ed32-474e-8ddb-ba16e57cd9ee service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 17:59:46 user nova-compute[74739]: WARNING nova.compute.manager [req-741753ae-9b40-4945-9fc7-5d0018ab5dfe req-953173ad-40f0-4200-b89e-b6ca34acd54f service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 17:59:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:59:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 17:59:47 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance spawned successfully.
Oct 25 17:59:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 17:59:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5ce33211-f35b-4ba7-a947-025ba07cb553 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.342s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-84b544ae-0ca1-4cbb-800d-30be498b0965 req-6e0ab280-49cc-45e3-a45c-38d8d523db98 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event volume-reimaged-e5d58217-3070-43c9-a028-2a6f26a07ef2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-84b544ae-0ca1-4cbb-800d-30be498b0965 req-6e0ab280-49cc-45e3-a45c-38d8d523db98 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-84b544ae-0ca1-4cbb-800d-30be498b0965 req-6e0ab280-49cc-45e3-a45c-38d8d523db98 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-84b544ae-0ca1-4cbb-800d-30be498b0965 req-6e0ab280-49cc-45e3-a45c-38d8d523db98 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-84b544ae-0ca1-4cbb-800d-30be498b0965 req-6e0ab280-49cc-45e3-a45c-38d8d523db98 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Processing event volume-reimaged-e5d58217-3070-43c9-a028-2a6f26a07ef2 {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance event wait completed in 32 seconds for volume-reimaged {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 17:59:56 user nova-compute[74739]: INFO nova.virt.block_device [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Booting with volume e5d58217-3070-43c9-a028-2a6f26a07ef2 at /dev/vda
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.utils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe73d64-45f3-4123-8c31-d662bc1b0f95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf0ebf-94b4-4695-87cc-f6238d4f29aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4014f1-e380-4259-b094-52ab7c34a9df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de3d6d0-358f-4127-af46-64cfcab92e11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 17:59:56 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 17:59:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5523c-be88-4080-bc74-aa12ec7158e0]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG os_brick.utils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:56 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating existing volume attachment record: 26013a99-b39b-49c7-8fe1-d65e327122df {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 17:59:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'info_cache' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 17:59:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance destroyed successfully.
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'resources' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb50c4378-46, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=920c81fa-f3ed-4e30-a9d6-7ac112de3038) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 17:59:59 user nova-compute[74739]: INFO os_vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 17:59:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ed32d-3c32-4d92-b31f-f50298a69309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 17:59:59 user nova-compute[74739]: No targets found.
Oct 25 17:59:59 user nova-compute[74739]: iSNS:
Oct 25 17:59:59 user nova-compute[74739]: No targets found.
Oct 25 17:59:59 user nova-compute[74739]: STATIC:
Oct 25 17:59:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 17:59:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75
Oct 25 17:59:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 17:59:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 17:59:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 17:59:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 17:59:59 user nova-compute[74739]: FIRMWARE:
Oct 25 17:59:59 user nova-compute[74739]: No targets found.
Oct 25 17:59:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 17:59:59 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 17:59:59 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bececf-088a-4c1c-8716-ea352dc342f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b725ace-7f8d-4584-a329-2acbb70feb79]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 17:59:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc33d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4132c1-a074-4390-9421-0e03386f8fa9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3599a10-108f-4710-bd39-e0d78d518167]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3af19-9b6e-4589-9b11-7ab6870e25c0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd5caed-4b0e-4fa7-80f5-f5d91cbc4a83]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b95eca-a7e9-4976-9376-a0beb316ae15]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --logout" returned: 0 in 0.187s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[430c3991-8002-45da-a08e-669aa3653447]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]
Oct 25 17:59:59 user nova-compute[74739]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.
Oct 25 17:59:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734ef17-bf22-492f-974c-83bcc72e87e0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== disconnect_volume: return (485ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start _get_guest_xml network_info=[{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c81805b1-80e0-4adf-9625-9570d69ea03e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'f9569bc3-c6d4-4eb1-9a6f-73549952097f', 'attached_at': '', 'detached_at': '', 'volume_id': '6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'serial': '6d801d48-7ffd-4afe-abaf-4917ea91a87b'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'numa_topology' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:59 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:59 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 17:59:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:00:00 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:00 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:00 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df657b1-299a-41b6-b5eb-219c397e13f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:00:00 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312b6f0-a508-431e-9721-88d4a62f10a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b] added
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11396e81-a234-4781-8006-93bcb88799dc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bad5d6-05d7-4d26-bdcf-9ab4ef8f70a2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLTkRVi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMLTkRVi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[49176077-62b4-4ca8-b8d4-7325c37ebf6c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMLTkRVi'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c5a855-280a-44e4-8703-0cf0513c72a1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c5e3e7-7717-43dd-9a31-e583f7176abd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8359d756-506c-466f-a273-0dc1240e6563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]
Oct 25 18:00:00 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a37948-21d4-4996-ae84-87ee827d88fa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[132bc944-3160-4ad1-9952-879134dd71fb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:00 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:00 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.721s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[46905b0a-ea0d-4855-8133-47cee7777c32]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:00 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.756s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== connect_volume: return (1757ms) {'type': 'block', 'scsi_wwn': '23735646637363630', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735646637363630', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'pci_devices' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:00:01 user nova-compute[74739]:   <uuid>f9569bc3-c6d4-4eb1-9a6f-73549952097f</uuid>
Oct 25 18:00:01 user nova-compute[74739]:   <name>instance-00000015</name>
Oct 25 18:00:01 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:00:01 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:00:01 user nova-compute[74739]:   <metadata>
Oct 25 18:00:01 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:00:01 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeTestJSON-server-1114405803</nova:name>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:creationTime>2023-10-25 17:59:59</nova:creationTime>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:00:01 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:00:01 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:owner>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:user uuid="73137a888d964149abda3bcac8293e01">tempest-AttachVolumeTestJSON-1878388259-project-member</nova:user>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:project uuid="1631249d25ff403daae6c41e03fd040f">tempest-AttachVolumeTestJSON-1878388259</nova:project>
Oct 25 18:00:01 user nova-compute[74739]:       </nova:owner>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:00:01 user nova-compute[74739]:       <nova:ports>
Oct 25 18:00:01 user nova-compute[74739]:         <nova:port uuid="b50c4378-46f7-449b-8c0b-1c4082488139">
Oct 25 18:00:01 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 18:00:01 user nova-compute[74739]:         </nova:port>
Oct 25 18:00:01 user nova-compute[74739]:       </nova:ports>
Oct 25 18:00:01 user nova-compute[74739]:     </nova:instance>
Oct 25 18:00:01 user nova-compute[74739]:   </metadata>
Oct 25 18:00:01 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:00:01 user nova-compute[74739]:     <system>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="serial">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="uuid">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 18:00:01 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:00:01 user nova-compute[74739]:     </system>
Oct 25 18:00:01 user nova-compute[74739]:   </sysinfo>
Oct 25 18:00:01 user nova-compute[74739]:   <os>
Oct 25 18:00:01 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:00:01 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:00:01 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:00:01 user nova-compute[74739]:   </os>
Oct 25 18:00:01 user nova-compute[74739]:   <features>
Oct 25 18:00:01 user nova-compute[74739]:     <acpi/>
Oct 25 18:00:01 user nova-compute[74739]:     <apic/>
Oct 25 18:00:01 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:00:01 user nova-compute[74739]:   </features>
Oct 25 18:00:01 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:00:01 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:00:01 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:00:01 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:00:01 user nova-compute[74739]:   </clock>
Oct 25 18:00:01 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:00:01 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:00:01 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:00:01 user nova-compute[74739]:   </cpu>
Oct 25 18:00:01 user nova-compute[74739]:   <devices>
Oct 25 18:00:01 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:00:01 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:00:01 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk"/>
Oct 25 18:00:01 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:00:01 user nova-compute[74739]:     </disk>
Oct 25 18:00:01 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:00:01 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:00:01 user nova-compute[74739]:       <source dev="/dev/sdd"/>
Oct 25 18:00:01 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:00:01 user nova-compute[74739]:       <serial>6d801d48-7ffd-4afe-abaf-4917ea91a87b</serial>
Oct 25 18:00:01 user nova-compute[74739]:     </disk>
Oct 25 18:00:01 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:00:01 user nova-compute[74739]:       <mac address="fa:16:3e:15:58:53"/>
Oct 25 18:00:01 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:01 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:00:01 user nova-compute[74739]:       <target dev="tapb50c4378-46"/>
Oct 25 18:00:01 user nova-compute[74739]:     </interface>
Oct 25 18:00:01 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:00:01 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/console.log" append="off"/>
Oct 25 18:00:01 user nova-compute[74739]:     </serial>
Oct 25 18:00:01 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:00:01 user nova-compute[74739]:     <video>
Oct 25 18:00:01 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:01 user nova-compute[74739]:     </video>
Oct 25 18:00:01 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:00:01 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:00:01 user nova-compute[74739]:     </rng>
Oct 25 18:00:01 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:00:01 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:00:01 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:00:01 user nova-compute[74739]:     </memballoon>
Oct 25 18:00:01 user nova-compute[74739]:   </devices>
Oct 25 18:00:01 user nova-compute[74739]: </domain>
Oct 25 18:00:01 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:00:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.228s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Cannot resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'migration_context' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.objects.base [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:58:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG os_vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86b17e61-f3fb-5ffe-8298-fdc487a5a85c', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb50c4378-46, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb50c4378-46, col_values=(('qos', UUID('77c11a2d-9a90-4e3a-a0c0-de27d09316f4')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb50c4378-46, col_values=(('external_ids', {'iface-id': 'b50c4378-46f7-449b-8c0b-1c4082488139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:58:53', 'vm-uuid': 'f9569bc3-c6d4-4eb1-9a6f-73549952097f'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:02 user nova-compute[74739]: INFO os_vif [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 18:00:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:04 user nova-compute[74739]: WARNING nova.compute.manager [req-876f2d60-794b-4637-b75c-ba031a34ada4 req-999a414a-84fb-46e1-b616-8845434b903d service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state stopped and task_state powering-on.
Oct 25 18:00:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:06 user nova-compute[74739]: WARNING nova.compute.manager [req-b24bdfbc-0235-4ee7-9b67-53bf3f809da9 req-8f667daa-c01a-4db5-8411-8bdfe3376f75 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state stopped and task_state powering-on.
Oct 25 18:00:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:00:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance rebooted successfully.
Oct 25 18:00:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-040dcabb-f209-4b78-8fc8-df4367f92ba1 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:00:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:00:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:00:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:13 user nova-compute[74739]: INFO nova.compute.manager [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Terminating instance
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:00:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-unplugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] No waiting events found dispatching network-vif-unplugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-29630d09-a5f0-4d9a-b9e9-4bfe9f2dbd7d req-cd73cb7b-9107-4d49-a729-82aafba21543 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-unplugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Instance destroyed successfully.
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lazy-loading 'resources' on Instance uuid 08290f01-eee3-48ee-b4a0-1d976346f139 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1424304868',display_name='tempest-ServersNegativeTestJSON-server-1424304868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1424304868',id=14,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:51:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e29d5c35e2c04cb18fa027da2ff93c62',ramdisk_id='',reservation_id='r-n0w1vfd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-334148990',owner_user_name='tempest-ServersNegativeTestJSON-334148990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:51:09Z,user_data=None,user_id='db9e105e32fb4d5782cc5af8eaa4c06b',uuid=08290f01-eee3-48ee-b4a0-1d976346f139,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converting VIF {"id": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "address": "fa:16:3e:44:99:85", "network": {"id": "490a8779-be3d-46c2-a8a0-660941a2b2c0", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1937257778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e29d5c35e2c04cb18fa027da2ff93c62", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap532b1fc6-30", "ovs_interfaceid": "532b1fc6-305d-4f99-9bb1-d70f334b5afb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG os_vif [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap532b1fc6-30, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8563370-5b1d-46fd-8a3d-230b8221cfb6) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:14 user nova-compute[74739]: INFO os_vif [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:99:85,bridge_name='br-int',has_traffic_filtering=True,id=532b1fc6-305d-4f99-9bb1-d70f334b5afb,network=Network(490a8779-be3d-46c2-a8a0-660941a2b2c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap532b1fc6-30')
Oct 25 18:00:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Deleting instance files /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139_del
Oct 25 18:00:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Deletion of /opt/stack/data/nova/instances/08290f01-eee3-48ee-b4a0-1d976346f139_del complete
Oct 25 18:00:15 user nova-compute[74739]: INFO nova.compute.manager [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:16 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Took 1.10 seconds to deallocate network for instance.
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-44e8da50-6af7-4bd7-8bb9-bb5c870cadf6 req-24125913-d613-4e7d-af7e-9c695d4c13cc service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-deleted-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:16 user nova-compute[74739]: INFO nova.compute.manager [req-44e8da50-6af7-4bd7-8bb9-bb5c870cadf6 req-24125913-d613-4e7d-af7e-9c695d4c13cc service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Neutron deleted interface 532b1fc6-305d-4f99-9bb1-d70f334b5afb; detaching it from the instance and deleting it from the info cache
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.network.neutron [req-44e8da50-6af7-4bd7-8bb9-bb5c870cadf6 req-24125913-d613-4e7d-af7e-9c695d4c13cc service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-44e8da50-6af7-4bd7-8bb9-bb5c870cadf6 req-24125913-d613-4e7d-af7e-9c695d4c13cc service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Detach interface failed, port_id=532b1fc6-305d-4f99-9bb1-d70f334b5afb, reason: Instance 08290f01-eee3-48ee-b4a0-1d976346f139 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] No waiting events found dispatching network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:16 user nova-compute[74739]: WARNING nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received unexpected event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb for instance with vm_state deleted and task_state None.
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Acquiring lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] Lock "08290f01-eee3-48ee-b4a0-1d976346f139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] No waiting events found dispatching network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:16 user nova-compute[74739]: WARNING nova.compute.manager [req-1722bb42-dc41-4917-ad14-a553e46e2036 req-1caaaa3a-eb2f-4f6f-8330-15dad1708380 service nova] [instance: 08290f01-eee3-48ee-b4a0-1d976346f139] Received unexpected event network-vif-plugged-532b1fc6-305d-4f99-9bb1-d70f334b5afb for instance with vm_state deleted and task_state None.
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:16 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Deleted allocations for instance 08290f01-eee3-48ee-b4a0-1d976346f139
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-845a5cbb-0f94-410b-88d3-54d15e9d5657 tempest-ServersNegativeTestJSON-334148990 tempest-ServersNegativeTestJSON-334148990-project-member] Lock "08290f01-eee3-48ee-b4a0-1d976346f139" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.117s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:17 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid '08290f01-eee3-48ee-b4a0-1d976346f139' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid '08290f01-eee3-48ee-b4a0-1d976346f139' (instance-0000000e)
Oct 25 18:00:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:00:17 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:17 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:17 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=24.960708618164062GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4425dd16-6194-48f7-8cd9-a956167c5cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:00:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:00:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Creating image(s)
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start _get_guest_xml network_info=[{"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '26013a99-b39b-49c7-8fe1-d65e327122df', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3723e87f-01ff-4e0a-aea0-21cbda1530c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5d58217-3070-43c9-a028-2a6f26a07ef2', 'serial': 'e5d58217-3070-43c9-a028-2a6f26a07ef2'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:00:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 18:00:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.objects.instance [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3723e87f-01ff-4e0a-aea0-21cbda1530c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:00:20 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:20 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:20 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[856d49f2-81ee-4119-949e-3ac0dc043b34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:00:20 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c4de9-c50b-4c7c-aa51-9077e6cb883d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2] added
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846f595-a533-45e1-89ea-519c66bd1bd0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a19c2d3-a9d7-4f1f-8ceb-4a7ec0450134]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHSATLpM {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sHSATLpM" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac0ad8-af3e-4047-9153-fc11da273ec8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sHSATLpM'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2862fb25-c8b2-4202-a859-0a9fc8b38cbd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f285193f-cd8c-40e2-a3fe-acf84196998f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf297f35-a72a-4d67-a26d-b17eb10efa2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]
Oct 25 18:00:20 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53296b7-7862-4e75-94b7-1259bbe0777f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237b039-7b11-4426-8332-d2fc80819541]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bf71fd-bc33-4746-bf89-9da7c762b5f5]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:00:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26130373262346536', 'path': '/dev/sdf'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130373262346536', 'path': '/dev/sdf'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1101093121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:00:21 user nova-compute[74739]:   <uuid>3723e87f-01ff-4e0a-aea0-21cbda1530c4</uuid>
Oct 25 18:00:21 user nova-compute[74739]:   <name>instance-0000001a</name>
Oct 25 18:00:21 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:00:21 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:00:21 user nova-compute[74739]:   <metadata>
Oct 25 18:00:21 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:00:21 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:00:21 user nova-compute[74739]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1101093121</nova:name>
Oct 25 18:00:21 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:00:20</nova:creationTime>
Oct 25 18:00:21 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:00:21 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:00:21 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:00:21 user nova-compute[74739]:       <nova:owner>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:user uuid="05983a2b250c415eb66a51571da2facf">tempest-ServerActionsV293TestJSON-580492283-project-member</nova:user>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:project uuid="d34a9a90a764499bb3e666c8ef83fe22">tempest-ServerActionsV293TestJSON-580492283</nova:project>
Oct 25 18:00:21 user nova-compute[74739]:       </nova:owner>
Oct 25 18:00:21 user nova-compute[74739]:       <nova:ports>
Oct 25 18:00:21 user nova-compute[74739]:         <nova:port uuid="f02cc6e2-452d-4e40-87d1-6d8eaea24266">
Oct 25 18:00:21 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 25 18:00:21 user nova-compute[74739]:         </nova:port>
Oct 25 18:00:21 user nova-compute[74739]:       </nova:ports>
Oct 25 18:00:21 user nova-compute[74739]:     </nova:instance>
Oct 25 18:00:21 user nova-compute[74739]:   </metadata>
Oct 25 18:00:21 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:00:21 user nova-compute[74739]:     <system>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="serial">3723e87f-01ff-4e0a-aea0-21cbda1530c4</entry>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="uuid">3723e87f-01ff-4e0a-aea0-21cbda1530c4</entry>
Oct 25 18:00:21 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:00:21 user nova-compute[74739]:     </system>
Oct 25 18:00:21 user nova-compute[74739]:   </sysinfo>
Oct 25 18:00:21 user nova-compute[74739]:   <os>
Oct 25 18:00:21 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:00:21 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:00:21 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:00:21 user nova-compute[74739]:   </os>
Oct 25 18:00:21 user nova-compute[74739]:   <features>
Oct 25 18:00:21 user nova-compute[74739]:     <acpi/>
Oct 25 18:00:21 user nova-compute[74739]:     <apic/>
Oct 25 18:00:21 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:00:21 user nova-compute[74739]:   </features>
Oct 25 18:00:21 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:00:21 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:00:21 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:00:21 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:00:21 user nova-compute[74739]:   </clock>
Oct 25 18:00:21 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:00:21 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:00:21 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:00:21 user nova-compute[74739]:   </cpu>
Oct 25 18:00:21 user nova-compute[74739]:   <devices>
Oct 25 18:00:21 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:00:21 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:00:21 user nova-compute[74739]:       <source dev="/dev/sdf"/>
Oct 25 18:00:21 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:00:21 user nova-compute[74739]:       <serial>e5d58217-3070-43c9-a028-2a6f26a07ef2</serial>
Oct 25 18:00:21 user nova-compute[74739]:     </disk>
Oct 25 18:00:21 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:00:21 user nova-compute[74739]:       <mac address="fa:16:3e:df:41:8b"/>
Oct 25 18:00:21 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:21 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:00:21 user nova-compute[74739]:       <target dev="tapf02cc6e2-45"/>
Oct 25 18:00:21 user nova-compute[74739]:     </interface>
Oct 25 18:00:21 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:00:21 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4/console.log" append="off"/>
Oct 25 18:00:21 user nova-compute[74739]:     </serial>
Oct 25 18:00:21 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:00:21 user nova-compute[74739]:     <video>
Oct 25 18:00:21 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:21 user nova-compute[74739]:     </video>
Oct 25 18:00:21 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:00:21 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:00:21 user nova-compute[74739]:     </rng>
Oct 25 18:00:21 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:00:21 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:00:21 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:00:21 user nova-compute[74739]:     </memballoon>
Oct 25 18:00:21 user nova-compute[74739]:   </devices>
Oct 25 18:00:21 user nova-compute[74739]: </domain>
Oct 25 18:00:21 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1101093121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG os_vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b30680ca-08b8-5d97-a9b0-0578c1b09391', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf02cc6e2-45, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf02cc6e2-45, col_values=(('qos', UUID('3953270e-8699-43f3-a827-d2a66506a52a')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf02cc6e2-45, col_values=(('external_ids', {'iface-id': 'f02cc6e2-452d-4e40-87d1-6d8eaea24266', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:41:8b', 'vm-uuid': '3723e87f-01ff-4e0a-aea0-21cbda1530c4'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:21 user nova-compute[74739]: INFO os_vif [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45')
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] No VIF found with MAC fa:16:3e:df:41:8b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:25 user nova-compute[74739]: WARNING nova.compute.manager [req-7efde2c1-ae52-4b7e-89fd-657ab2c8688a req-c8cf7307-bf8b-4278-b1e7-68ab748247e5 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state active and task_state rebuild_spawning.
Oct 25 18:00:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:00:25 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance spawned successfully.
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:26 user nova-compute[74739]: DEBUG nova.objects.instance [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74739) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 18:00:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84b544ae-0ca1-4cbb-800d-30be498b0965 tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.101s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:27 user nova-compute[74739]: WARNING nova.compute.manager [req-b6d0eab6-52ee-4629-b3a0-ce7c683084f9 req-8683e48c-1dda-45f2-acf2-381c55f274b0 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state active and task_state None.
Oct 25 18:00:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:00:39 user nova-compute[74739]: INFO nova.compute.claims [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Claim successful on node user
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:00:39 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:00:39 user nova-compute[74739]: DEBUG nova.policy [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574f9cf219ae4acf8e807939b600ddfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e75de614674189b1a76798983d3fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:00:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Creating image(s)
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.255s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk 1073741824" returned: 0 in 0.105s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.368s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Successfully created port: 420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.240s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:00:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Cannot resize image /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Ensure instance console log exists: /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Successfully updated port: 420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-changed-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing instance network info cache due to event network-changed-420593ec-52b2-4b39-bcf8-c657c2448019. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Instance network_info: |[{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.neutron [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing network info cache for port 420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Start _get_guest_xml network_info=[{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:00:41 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:41 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:41 user nova-compute[74739]: DEBUG nova.objects.instance [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'pci_devices' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:00:42 user nova-compute[74739]:   <uuid>20291d64-e5d7-47f5-8b9c-4e57dd4de314</uuid>
Oct 25 18:00:42 user nova-compute[74739]:   <name>instance-0000001c</name>
Oct 25 18:00:42 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:00:42 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:00:42 user nova-compute[74739]:   <metadata>
Oct 25 18:00:42 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:00:42 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:00:41</nova:creationTime>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:00:42 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:00:42 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:owner>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:00:42 user nova-compute[74739]:       </nova:owner>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:00:42 user nova-compute[74739]:       <nova:ports>
Oct 25 18:00:42 user nova-compute[74739]:         <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:00:42 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:00:42 user nova-compute[74739]:         </nova:port>
Oct 25 18:00:42 user nova-compute[74739]:       </nova:ports>
Oct 25 18:00:42 user nova-compute[74739]:     </nova:instance>
Oct 25 18:00:42 user nova-compute[74739]:   </metadata>
Oct 25 18:00:42 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:00:42 user nova-compute[74739]:     <system>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="serial">20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="uuid">20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:00:42 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:00:42 user nova-compute[74739]:     </system>
Oct 25 18:00:42 user nova-compute[74739]:   </sysinfo>
Oct 25 18:00:42 user nova-compute[74739]:   <os>
Oct 25 18:00:42 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:00:42 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:00:42 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:00:42 user nova-compute[74739]:   </os>
Oct 25 18:00:42 user nova-compute[74739]:   <features>
Oct 25 18:00:42 user nova-compute[74739]:     <acpi/>
Oct 25 18:00:42 user nova-compute[74739]:     <apic/>
Oct 25 18:00:42 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:00:42 user nova-compute[74739]:   </features>
Oct 25 18:00:42 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:00:42 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:00:42 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:00:42 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:00:42 user nova-compute[74739]:   </clock>
Oct 25 18:00:42 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:00:42 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:00:42 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:00:42 user nova-compute[74739]:   </cpu>
Oct 25 18:00:42 user nova-compute[74739]:   <devices>
Oct 25 18:00:42 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:00:42 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:00:42 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk"/>
Oct 25 18:00:42 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:00:42 user nova-compute[74739]:     </disk>
Oct 25 18:00:42 user nova-compute[74739]:     <disk type="file" device="cdrom">
Oct 25 18:00:42 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none"/>
Oct 25 18:00:42 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config"/>
Oct 25 18:00:42 user nova-compute[74739]:       <target dev="hda" bus="ide"/>
Oct 25 18:00:42 user nova-compute[74739]:     </disk>
Oct 25 18:00:42 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:00:42 user nova-compute[74739]:       <mac address="fa:16:3e:82:cc:4e"/>
Oct 25 18:00:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:42 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:00:42 user nova-compute[74739]:       <target dev="tap420593ec-52"/>
Oct 25 18:00:42 user nova-compute[74739]:     </interface>
Oct 25 18:00:42 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:00:42 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log" append="off"/>
Oct 25 18:00:42 user nova-compute[74739]:     </serial>
Oct 25 18:00:42 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:00:42 user nova-compute[74739]:     <video>
Oct 25 18:00:42 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:42 user nova-compute[74739]:     </video>
Oct 25 18:00:42 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:00:42 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:00:42 user nova-compute[74739]:     </rng>
Oct 25 18:00:42 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:00:42 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:00:42 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:00:42 user nova-compute[74739]:     </memballoon>
Oct 25 18:00:42 user nova-compute[74739]:   </devices>
Oct 25 18:00:42 user nova-compute[74739]: </domain>
Oct 25 18:00:42 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG os_vif [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab67081b-dfe5-55c0-9ac7-e1c8ca287ca9', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap420593ec-52, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap420593ec-52, col_values=(('qos', UUID('ca933bd6-f825-4dc4-b60c-1b5a89b3ecb2')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap420593ec-52, col_values=(('external_ids', {'iface-id': '420593ec-52b2-4b39-bcf8-c657c2448019', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:cc:4e', 'vm-uuid': '20291d64-e5d7-47f5-8b9c-4e57dd4de314'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:42 user nova-compute[74739]: INFO os_vif [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52')
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name hda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No VIF found with MAC fa:16:3e:82:cc:4e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:00:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Using config drive
Oct 25 18:00:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Creating config drive at /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config
Oct 25 18:00:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp353dagrj {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp353dagrj" returned: 0 in 0.082s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updated VIF entry in instance network info cache for port 420593ec-52b2-4b39-bcf8-c657c2448019. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cabb694c-3470-4a60-a6a8-ba26858cf1c8 req-15bd2db3-ed16-4b6d-93ae-c228c83b65ff service nova] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:00:43 user nova-compute[74739]: INFO nova.compute.claims [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Claim successful on node user
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:00:43 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:00:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.policy [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2c66017a2b34284bb238dc9b247d170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9251de527bf478ca04612fad735dbf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:00:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Creating image(s)
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "/opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "/opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:44 user nova-compute[74739]: WARNING nova.compute.manager [req-99cc5fc6-07f2-4a01-93b0-6a754b4b1a6c req-ba8460d2-0f52-4793-b07c-40d3c6e84a05 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 for instance with vm_state building and task_state spawning.
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.255s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk 1073741824" returned: 0 in 0.065s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.235s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Cannot resize image /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Ensure instance console log exists: /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Successfully created port: a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Successfully updated port: a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquired lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:46 user nova-compute[74739]: WARNING nova.compute.manager [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 for instance with vm_state building and task_state spawning.
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-changed-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Refreshing instance network info cache due to event network-changed-a702b846-770e-4580-ad3c-51987a59b35b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Acquiring lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:00:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Instance spawned successfully.
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:46 user nova-compute[74739]: INFO nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Took 6.79 seconds to spawn the instance on the hypervisor.
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating instance_info_cache with network_info: [{"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:46 user nova-compute[74739]: INFO nova.compute.manager [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Took 7.76 seconds to build instance.
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-284d00df-3e2e-447b-9877-74970c827ad2 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.886s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Releasing lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Instance network_info: |[{"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Acquired lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.neutron [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Refreshing network info cache for port a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Start _get_guest_xml network_info=[{"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:00:47 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:47 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1046136457',display_name='tempest-TestServerVolumeAttachmentScenario-server-1046136457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1046136457',id=29,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ9Z/88zEYKF7y9OJYCmDQycEUIk117Ub58z+1DKYgXGIY8K+Z01nnW4sNzEivhsbB+E8Zz18icIcZnstnsDfhgyxjcT6VwfLgxjFeBT5ThIfRi1mTZEmWtvO7lOgE5GA==',key_name='tempest-keypair-304347904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9251de527bf478ca04612fad735dbf8',ramdisk_id='',reservation_id='r-c452d6e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-715823229',owner_user_name='tempest-TestServerVolumeAttachmentScenario-715823229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c66017a2b34284bb238dc9b247d170',uuid=0c215818-8652-4adf-8aac-c45847b66df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converting VIF {"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:00:47 user nova-compute[74739]:   <uuid>0c215818-8652-4adf-8aac-c45847b66df3</uuid>
Oct 25 18:00:47 user nova-compute[74739]:   <name>instance-0000001d</name>
Oct 25 18:00:47 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:00:47 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:00:47 user nova-compute[74739]:   <metadata>
Oct 25 18:00:47 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:00:47 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1046136457</nova:name>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:00:47</nova:creationTime>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:00:47 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:00:47 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:owner>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:user uuid="d2c66017a2b34284bb238dc9b247d170">tempest-TestServerVolumeAttachmentScenario-715823229-project-member</nova:user>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:project uuid="a9251de527bf478ca04612fad735dbf8">tempest-TestServerVolumeAttachmentScenario-715823229</nova:project>
Oct 25 18:00:47 user nova-compute[74739]:       </nova:owner>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:00:47 user nova-compute[74739]:       <nova:ports>
Oct 25 18:00:47 user nova-compute[74739]:         <nova:port uuid="a702b846-770e-4580-ad3c-51987a59b35b">
Oct 25 18:00:47 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 18:00:47 user nova-compute[74739]:         </nova:port>
Oct 25 18:00:47 user nova-compute[74739]:       </nova:ports>
Oct 25 18:00:47 user nova-compute[74739]:     </nova:instance>
Oct 25 18:00:47 user nova-compute[74739]:   </metadata>
Oct 25 18:00:47 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:00:47 user nova-compute[74739]:     <system>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="serial">0c215818-8652-4adf-8aac-c45847b66df3</entry>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="uuid">0c215818-8652-4adf-8aac-c45847b66df3</entry>
Oct 25 18:00:47 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:00:47 user nova-compute[74739]:     </system>
Oct 25 18:00:47 user nova-compute[74739]:   </sysinfo>
Oct 25 18:00:47 user nova-compute[74739]:   <os>
Oct 25 18:00:47 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:00:47 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:00:47 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:00:47 user nova-compute[74739]:   </os>
Oct 25 18:00:47 user nova-compute[74739]:   <features>
Oct 25 18:00:47 user nova-compute[74739]:     <acpi/>
Oct 25 18:00:47 user nova-compute[74739]:     <apic/>
Oct 25 18:00:47 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:00:47 user nova-compute[74739]:   </features>
Oct 25 18:00:47 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:00:47 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:00:47 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:00:47 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:00:47 user nova-compute[74739]:   </clock>
Oct 25 18:00:47 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:00:47 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:00:47 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:00:47 user nova-compute[74739]:   </cpu>
Oct 25 18:00:47 user nova-compute[74739]:   <devices>
Oct 25 18:00:47 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:00:47 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:00:47 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk"/>
Oct 25 18:00:47 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:00:47 user nova-compute[74739]:     </disk>
Oct 25 18:00:47 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:00:47 user nova-compute[74739]:       <mac address="fa:16:3e:d0:50:8b"/>
Oct 25 18:00:47 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:47 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:00:47 user nova-compute[74739]:       <target dev="tapa702b846-77"/>
Oct 25 18:00:47 user nova-compute[74739]:     </interface>
Oct 25 18:00:47 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:00:47 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/console.log" append="off"/>
Oct 25 18:00:47 user nova-compute[74739]:     </serial>
Oct 25 18:00:47 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:00:47 user nova-compute[74739]:     <video>
Oct 25 18:00:47 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:47 user nova-compute[74739]:     </video>
Oct 25 18:00:47 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:00:47 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:00:47 user nova-compute[74739]:     </rng>
Oct 25 18:00:47 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:00:47 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:00:47 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:00:47 user nova-compute[74739]:     </memballoon>
Oct 25 18:00:47 user nova-compute[74739]:   </devices>
Oct 25 18:00:47 user nova-compute[74739]: </domain>
Oct 25 18:00:47 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1046136457',display_name='tempest-TestServerVolumeAttachmentScenario-server-1046136457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1046136457',id=29,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ9Z/88zEYKF7y9OJYCmDQycEUIk117Ub58z+1DKYgXGIY8K+Z01nnW4sNzEivhsbB+E8Zz18icIcZnstnsDfhgyxjcT6VwfLgxjFeBT5ThIfRi1mTZEmWtvO7lOgE5GA==',key_name='tempest-keypair-304347904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a9251de527bf478ca04612fad735dbf8',ramdisk_id='',reservation_id='r-c452d6e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-715823229',owner_user_name='tempest-TestServerVolumeAttachmentScenario-715823229-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c66017a2b34284bb238dc9b247d170',uuid=0c215818-8652-4adf-8aac-c45847b66df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converting VIF {"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG os_vif [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd17b4b7-5073-524d-817e-5b7afa8dd780', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa702b846-77, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa702b846-77, col_values=(('qos', UUID('aecf5782-ea80-461f-ab95-df5eccf6d281')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa702b846-77, col_values=(('external_ids', {'iface-id': 'a702b846-770e-4580-ad3c-51987a59b35b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:50:8b', 'vm-uuid': '0c215818-8652-4adf-8aac-c45847b66df3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:47 user nova-compute[74739]: INFO os_vif [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77')
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No VIF found with MAC fa:16:3e:d0:50:8b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.neutron [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updated VIF entry in instance network info cache for port a702b846-770e-4580-ad3c-51987a59b35b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG nova.network.neutron [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating instance_info_cache with network_info: [{"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4aa415d2-9425-48e3-8c18-fad9a9fa9462 req-08b9124a-8f15-4a5c-b3b7-76a254ad8e9c service nova] Releasing lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] No waiting events found dispatching network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:49 user nova-compute[74739]: WARNING nova.compute.manager [req-01bec004-1fd6-4d4d-bc19-8e44dcb8e308 req-2abb1cb3-1955-4c84-a368-2fd338cb6398 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received unexpected event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b for instance with vm_state building and task_state spawning.
Oct 25 18:00:49 user nova-compute[74739]: INFO nova.compute.manager [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Rescuing
Oct 25 18:00:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance destroyed successfully.
Oct 25 18:00:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Attempting a stable device rescue
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 18:00:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Creating image(s)
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'trusted_certs' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] No waiting events found dispatching network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:51 user nova-compute[74739]: WARNING nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received unexpected event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b for instance with vm_state building and task_state spawning.
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:51 user nova-compute[74739]: WARNING nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state rescuing.
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:51 user nova-compute[74739]: WARNING nova.compute.manager [req-ac1b3186-130a-41fb-92ab-288ce5300f69 req-0a0d13bf-c406-4f0d-9e1a-6383e071f42d service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state rescuing.
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:00:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Instance spawned successfully.
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:00:52 user nova-compute[74739]: INFO nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Took 8.33 seconds to spawn the instance on the hypervisor.
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.part --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.virt.images [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ace42c46-ede1-4853-9078-a1d3daabdc23 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 18:00:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.part /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:52 user nova-compute[74739]: INFO nova.compute.manager [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Took 9.56 seconds to build instance.
Oct 25 18:00:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c529a5c3-4d05-4de9-bbd4-cd8bd06308e3 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.690s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.part /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.converted" returned: 0 in 0.536s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.127s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba,backing_fmt=raw /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba,backing_fmt=raw /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue" returned: 0 in 0.075s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "33ac72c090c51a35b4f67dd8291e8104d6690eba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'migration_context' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<eff7760a-3bdd-4322-bb7d-8bd9ad669a14> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start _get_guest_xml network_info=[{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:ed:29:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ace42c46-ede1-4853-9078-a1d3daabdc23', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '27bde004-a16e-452f-b6b4-93328885bafc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'eff7760a-3bdd-4322-bb7d-8bd9ad669a14', 'attached_at': '', 'detached_at': '', 'volume_id': '4d9364d8-b977-44ef-9823-a50224b6e511', 'serial': '4d9364d8-b977-44ef-9823-a50224b6e511'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<eff7760a-3bdd-4322-bb7d-8bd9ad669a14> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'numa_topology' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<eff7760a-3bdd-4322-bb7d-8bd9ad669a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'vcpu_model' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.objects.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<eff7760a-3bdd-4322-bb7d-8bd9ad669a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:00:53 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:53 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:00:53 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d20327c-cdc3-45aa-a1b4-07024aade82e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VKQUTbmO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 25 18:00:53 user nova-compute[74739]: node.name = iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:00:53 user nova-compute[74739]: node.tpgt = -1
Oct 25 18:00:53 user nova-compute[74739]: node.startup = automatic
Oct 25 18:00:53 user nova-compute[74739]: node.leading_login = No
Oct 25 18:00:53 user nova-compute[74739]: iface.iscsi_ifacename = default
Oct 25 18:00:53 user nova-compute[74739]: iface.net_ifacename = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.ipaddress = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.prefix_len = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.hwaddress = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.transport_name = tcp
Oct 25 18:00:53 user nova-compute[74739]: iface.initiatorname = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.vlan_id = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.vlan_priority = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.vlan_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.iface_num = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.mtu = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.port = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.bootproto = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.subnet_mask = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.gateway = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_alt_client_id_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_alt_client_id = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_dns = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_learn_iqn = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_req_vendor_id_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_vendor_id_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_vendor_id = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.dhcp_slp_da = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.fragmentation = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.gratuitous_arp = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.incoming_forwarding = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.tos_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.tos = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.ttl = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.delayed_ack = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.tcp_nagle = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.tcp_wsf_state = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.tcp_wsf = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.tcp_timer_scale = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.tcp_timestamp = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.redirect = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.def_task_mgmt_timeout = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.header_digest = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.data_digest = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.immediate_data = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.initial_r2t = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.data_seq_inorder = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.data_pdu_inorder = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.erl = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.max_receive_data_len = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.first_burst_len = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.max_outstanding_r2t = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.max_burst_len = 0
Oct 25 18:00:53 user nova-compute[74739]: iface.chap_auth = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.bidi_chap = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.strict_login_compliance = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.discovery_auth = <empty>
Oct 25 18:00:53 user nova-compute[74739]: iface.discovery_logout = <empty>
Oct 25 18:00:53 user nova-compute[74739]: node.discovery_address = <empty>
Oct 25 18:00:53 user nova-compute[74739]: node.discovery_port = 0
Oct 25 18:00:53 user nova-compute[74739]: node.discovery_type = static
Oct 25 18:00:53 user nova-compute[74739]: node.session.initial_cmdsn = 0
Oct 25 18:00:53 user nova-compute[74739]: node.session.initial_login_retry_max = 8
Oct 25 18:00:53 user nova-compute[74739]: node.session.xmit_thread_priority = -20
Oct 25 18:00:53 user nova-compute[74739]: node.session.cmds_max = 128
Oct 25 18:00:53 user nova-compute[74739]: node.session.queue_depth = 32
Oct 25 18:00:53 user nova-compute[74739]: node.session.nr_sessions = 1
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.authmethod = CHAP
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.username = VKQUTbmO
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.password = ***
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.username_in = <empty>
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.password_in = <empty>
Oct 25 18:00:53 user nova-compute[74739]: node.session.auth.chap_algs = MD5
Oct 25 18:00:53 user nova-compute[74739]: node.session.timeo.replacement_timeout = 120
Oct 25 18:00:53 user nova-compute[74739]: node.session.err_timeo.abort_timeout = 15
Oct 25 18:00:53 user nova-compute[74739]: node.session.err_timeo.lu_reset_timeout = 30
Oct 25 18:00:53 user nova-compute[74739]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 25 18:00:53 user nova-compute[74739]: node.session.err_timeo.host_reset_timeout = 60
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.FastAbort = Yes
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.InitialR2T = No
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.ImmediateData = Yes
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.FirstBurstLength = 262144
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.MaxBurstLength = 16776192
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.DefaultTime2Retain = 0
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.DefaultTime2Wait = 2
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.MaxConnections = 1
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 25 18:00:53 user nova-compute[74739]: node.session.iscsi.ERL = 0
Oct 25 18:00:53 user nova-compute[74739]: node.session.scan = manual
Oct 25 18:00:53 user nova-compute[74739]: node.session.reopen_max = 0
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].address = 172.16.0.220
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].port = 3260
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].startup = manual
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].tcp.window_size = 524288
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].tcp.type_of_service = 0
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].timeo.logout_timeout = 15
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].timeo.login_timeout = 15
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].timeo.auth_timeout = 45
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].timeo.noop_out_interval = 5
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].timeo.noop_out_timeout = 5
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.HeaderDigest = None
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.DataDigest = None
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.IFMarker = No
Oct 25 18:00:53 user nova-compute[74739]: node.conn[0].iscsi.OFMarker = No
Oct 25 18:00:53 user nova-compute[74739]: # END RECORD
Oct 25 18:00:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12e387-821d-44b4-a330-c7e753404d16]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e00a5-bb53-439b-a667-0edf3eae36c4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKQUTbmO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKQUTbmO" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4003fe2-6cc1-4b98-aa04-32226246143f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKQUTbmO'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f626ce5-b9d8-4457-9f39-371f2f10b332]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c495784e-3d5d-4262-9286-c4fdbc52dc46]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:00:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] HCTL ('36', '0', '0', 0) found on session 23 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d5d26-9c19-4354-86a6-1069e3123671]: (4, ('0 0 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Searching for a device in session 23 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '23166666139376132', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166666139376132', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-207586830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-207586830',id=27,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:59:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-jxg9a0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T17:59:40Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=eff7760a-3bdd-4322-bb7d-8bd9ad669a14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:ed:29:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "vif_mac": "fa:16:3e:ed:29:95"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'pci_devices' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.objects.base [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Object Instance<eff7760a-3bdd-4322-bb7d-8bd9ad669a14> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:00:54 user nova-compute[74739]:   <uuid>eff7760a-3bdd-4322-bb7d-8bd9ad669a14</uuid>
Oct 25 18:00:54 user nova-compute[74739]:   <name>instance-0000001b</name>
Oct 25 18:00:54 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:00:54 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:00:54 user nova-compute[74739]:   <metadata>
Oct 25 18:00:54 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:00:54 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-207586830</nova:name>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:00:53</nova:creationTime>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:00:54 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:00:54 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:owner>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:user uuid="964d6de8a5b7400ea3a45d666a499632">tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member</nova:user>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:project uuid="3ed00ba170e845c8ad57fe410d8388b7">tempest-ServerBootFromVolumeStableRescueTest-1201378770</nova:project>
Oct 25 18:00:54 user nova-compute[74739]:       </nova:owner>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:00:54 user nova-compute[74739]:       <nova:ports>
Oct 25 18:00:54 user nova-compute[74739]:         <nova:port uuid="457f798c-592f-43b3-b337-5ff9e88f23c9">
Oct 25 18:00:54 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 18:00:54 user nova-compute[74739]:         </nova:port>
Oct 25 18:00:54 user nova-compute[74739]:       </nova:ports>
Oct 25 18:00:54 user nova-compute[74739]:     </nova:instance>
Oct 25 18:00:54 user nova-compute[74739]:   </metadata>
Oct 25 18:00:54 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:00:54 user nova-compute[74739]:     <system>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="serial">eff7760a-3bdd-4322-bb7d-8bd9ad669a14</entry>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="uuid">eff7760a-3bdd-4322-bb7d-8bd9ad669a14</entry>
Oct 25 18:00:54 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:00:54 user nova-compute[74739]:     </system>
Oct 25 18:00:54 user nova-compute[74739]:   </sysinfo>
Oct 25 18:00:54 user nova-compute[74739]:   <os>
Oct 25 18:00:54 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:00:54 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:00:54 user nova-compute[74739]:   </os>
Oct 25 18:00:54 user nova-compute[74739]:   <features>
Oct 25 18:00:54 user nova-compute[74739]:     <acpi/>
Oct 25 18:00:54 user nova-compute[74739]:     <apic/>
Oct 25 18:00:54 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:00:54 user nova-compute[74739]:   </features>
Oct 25 18:00:54 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:00:54 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:00:54 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:00:54 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:00:54 user nova-compute[74739]:   </clock>
Oct 25 18:00:54 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:00:54 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:00:54 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:00:54 user nova-compute[74739]:   </cpu>
Oct 25 18:00:54 user nova-compute[74739]:   <devices>
Oct 25 18:00:54 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:00:54 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:00:54 user nova-compute[74739]:       <source dev="/dev/sde"/>
Oct 25 18:00:54 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:00:54 user nova-compute[74739]:       <serial>4d9364d8-b977-44ef-9823-a50224b6e511</serial>
Oct 25 18:00:54 user nova-compute[74739]:     </disk>
Oct 25 18:00:54 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:00:54 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:00:54 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue"/>
Oct 25 18:00:54 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:00:54 user nova-compute[74739]:       <boot order="1"/>
Oct 25 18:00:54 user nova-compute[74739]:     </disk>
Oct 25 18:00:54 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:00:54 user nova-compute[74739]:       <mac address="fa:16:3e:ed:29:95"/>
Oct 25 18:00:54 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:54 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:00:54 user nova-compute[74739]:       <target dev="tap457f798c-59"/>
Oct 25 18:00:54 user nova-compute[74739]:     </interface>
Oct 25 18:00:54 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:00:54 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/console.log" append="off"/>
Oct 25 18:00:54 user nova-compute[74739]:     </serial>
Oct 25 18:00:54 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:00:54 user nova-compute[74739]:     <video>
Oct 25 18:00:54 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:00:54 user nova-compute[74739]:     </video>
Oct 25 18:00:54 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:00:54 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:00:54 user nova-compute[74739]:     </rng>
Oct 25 18:00:54 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:00:54 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:00:54 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:00:54 user nova-compute[74739]:     </memballoon>
Oct 25 18:00:54 user nova-compute[74739]:   </devices>
Oct 25 18:00:54 user nova-compute[74739]: </domain>
Oct 25 18:00:54 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:00:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance destroyed successfully.
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:00:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] No VIF found with MAC fa:16:3e:ed:29:95, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:55 user nova-compute[74739]: WARNING nova.compute.manager [req-dc98c230-0711-42a6-ab32-365e92cac6ae req-b464b16e-1e40-43f5-a51f-f1ef2531f8ac service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state rescuing.
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:00:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:00:57 user nova-compute[74739]: WARNING nova.compute.manager [req-64018742-34d5-4249-b4c2-c305ae064aeb req-d438f0d4-f14d-457d-ad2c-78c50a4d5501 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state rescuing.
Oct 25 18:00:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9f2ba84a-9c53-4ff2-9ded-a8c06dce5ff2 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:01:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:01:10 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [{"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-3ebb8df7-813e-4118-9689-f56934edf958" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:13 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:01:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:01:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:17 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:01:17 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:01:17 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7422MB free_disk=24.823360443115234GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4425dd16-6194-48f7-8cd9-a956167c5cc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 0c215818-8652-4adf-8aac-c45847b66df3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:01:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:01:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:25 user nova-compute[74739]: INFO nova.compute.manager [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Terminating instance
Oct 25 18:01:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:01:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-f11abd8d-15c7-4caa-9063-d9a7d3c1b427 req-14557586-73cc-4b8d-9ed9-f501ba4cf645 service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-unplugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Instance destroyed successfully.
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.objects.instance [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lazy-loading 'resources' on Instance uuid 4425dd16-6194-48f7-8cd9-a956167c5cc4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:55:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1908865262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1908865262',id=20,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf5ADe13sKGNtLF+nRidm4gdmMPSRnreZfu75U2a81p4V/dbYBYxySzqYKBQuDuc8XbXPVuioircPq9BYkWt1NPUViQnfi/UF5Ld/kW8Z87VY6dy6sPk5Ba5xD4mZ50HA==',key_name='tempest-keypair-1385679357',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2a1dd2b0954a74be154b7082170334',ramdisk_id='',reservation_id='r-reb881lk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-744521439',owner_user_name='tempest-AttachVolumeShelveTestJSON-744521439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:59:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e140ed4e3e2f4d5abc2e08e1400715de',uuid=4425dd16-6194-48f7-8cd9-a956167c5cc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converting VIF {"id": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "address": "fa:16:3e:b9:2f:6e", "network": {"id": "81be7d9f-85c5-472c-98aa-bced2e92212d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1589758763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2a1dd2b0954a74be154b7082170334", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e9eb48b-a5", "ovs_interfaceid": "6e9eb48b-a500-4a34-b011-fc2342c2b2de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG os_vif [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e9eb48b-a5, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f2c3d79-af04-41df-887d-6c5399918c9b) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:26 user nova-compute[74739]: INFO os_vif [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:2f:6e,bridge_name='br-int',has_traffic_filtering=True,id=6e9eb48b-a500-4a34-b011-fc2342c2b2de,network=Network(81be7d9f-85c5-472c-98aa-bced2e92212d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e9eb48b-a5')
Oct 25 18:01:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Deleting instance files /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4_del
Oct 25 18:01:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Deletion of /opt/stack/data/nova/instances/4425dd16-6194-48f7-8cd9-a956167c5cc4_del complete
Oct 25 18:01:26 user nova-compute[74739]: INFO nova.compute.manager [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 25 18:01:26 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:01:26 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] Acquiring lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] No waiting events found dispatching network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:01:28 user nova-compute[74739]: WARNING nova.compute.manager [req-feeeafdb-94fe-4c8e-9f2b-57f855fba2b7 req-8539e004-d81c-4588-8849-a8d1d0ab883e service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received unexpected event network-vif-plugged-6e9eb48b-a500-4a34-b011-fc2342c2b2de for instance with vm_state active and task_state deleting.
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:01:28 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Took 1.50 seconds to deallocate network for instance.
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-fd23ef23-2aec-4438-a5ef-61f0f5f1ec45 req-8e77d499-74de-4a55-b1be-19ba022f607b service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Received event network-vif-deleted-6e9eb48b-a500-4a34-b011-fc2342c2b2de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:01:28 user nova-compute[74739]: INFO nova.compute.manager [req-fd23ef23-2aec-4438-a5ef-61f0f5f1ec45 req-8e77d499-74de-4a55-b1be-19ba022f607b service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Neutron deleted interface 6e9eb48b-a500-4a34-b011-fc2342c2b2de; detaching it from the instance and deleting it from the info cache
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-fd23ef23-2aec-4438-a5ef-61f0f5f1ec45 req-8e77d499-74de-4a55-b1be-19ba022f607b service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-fd23ef23-2aec-4438-a5ef-61f0f5f1ec45 req-8e77d499-74de-4a55-b1be-19ba022f607b service nova] [instance: 4425dd16-6194-48f7-8cd9-a956167c5cc4] Detach interface failed, port_id=6e9eb48b-a500-4a34-b011-fc2342c2b2de, reason: Instance 4425dd16-6194-48f7-8cd9-a956167c5cc4 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:01:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:29 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Deleted allocations for instance 4425dd16-6194-48f7-8cd9-a956167c5cc4
Oct 25 18:01:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-41400533-3501-48ff-9f4f-d44ce49911c0 tempest-AttachVolumeShelveTestJSON-744521439 tempest-AttachVolumeShelveTestJSON-744521439-project-member] Lock "4425dd16-6194-48f7-8cd9-a956167c5cc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.229s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:29 user nova-compute[74739]: INFO nova.compute.manager [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Detaching volume 13c475e6-2753-4712-8617-bab64e53aa75
Oct 25 18:01:29 user nova-compute[74739]: INFO nova.virt.block_device [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Attempting to driver detach volume 13c475e6-2753-4712-8617-bab64e53aa75 from mountpoint /dev/vdb
Oct 25 18:01:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Attempting to detach device vdb from instance df989d46-17b2-48b1-bff6-a826b63665d4 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:01:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:01:29 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:01:29 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:01:29 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:01:29 user nova-compute[74739]:   <serial>13c475e6-2753-4712-8617-bab64e53aa75</serial>
Oct 25 18:01:29 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:01:29 user nova-compute[74739]: </disk>
Oct 25 18:01:29 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:01:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully detached device vdb from instance df989d46-17b2-48b1-bff6-a826b63665d4 from the persistent domain config.
Oct 25 18:01:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df989d46-17b2-48b1-bff6-a826b63665d4 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:01:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:01:29 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:01:29 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:01:29 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:01:29 user nova-compute[74739]:   <serial>13c475e6-2753-4712-8617-bab64e53aa75</serial>
Oct 25 18:01:29 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:01:29 user nova-compute[74739]: </disk>
Oct 25 18:01:29 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing instance network info cache due to event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updated VIF entry in instance network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing instance network info cache due to event network-changed-ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Acquiring lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Acquired lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:01:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Refreshing network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:01:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updated VIF entry in instance network info cache for port ac34d476-39cc-4090-b50a-5bc5f0e340a1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:01:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [{"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:01:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6698326-e78b-41fd-bf97-311b0a63fbfc req-e939ffb5-b411-43d6-9a21-700d7e64ab50 service nova] Releasing lock "refresh_cache-df989d46-17b2-48b1-bff6-a826b63665d4" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:01:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:01:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df989d46-17b2-48b1-bff6-a826b63665d4 is timed out.
Oct 25 18:01:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully detached device vdb from instance df989d46-17b2-48b1-bff6-a826b63665d4 from the live domain config.
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ctgIOesE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:01:50 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:01:50 user nova-compute[74739]: INFO nova.compute.manager [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Detaching volume 6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[444b5ee8-7bcf-4a55-b22d-bcf7696770e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:01:50 user nova-compute[74739]: No targets found.
Oct 25 18:01:50 user nova-compute[74739]: iSNS:
Oct 25 18:01:50 user nova-compute[74739]: No targets found.
Oct 25 18:01:50 user nova-compute[74739]: STATIC:
Oct 25 18:01:50 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:01:50 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:01:50 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:01:50 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75
Oct 25 18:01:50 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:01:50 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:01:50 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2
Oct 25 18:01:50 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:01:50 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:01:50 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 18:01:50 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:01:50 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:01:50 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:01:50 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:01:50 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:01:50 user nova-compute[74739]: FIRMWARE:
Oct 25 18:01:50 user nova-compute[74739]: No targets found.
Oct 25 18:01:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:01:50 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:01:50 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[85627808-2664-41bc-894b-23771969c52c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: INFO nova.virt.block_device [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Attempting to driver detach volume 6d801d48-7ffd-4afe-abaf-4917ea91a87b from mountpoint /dev/vdb
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Attempting to detach device vdb from instance f9569bc3-c6d4-4eb1-9a6f-73549952097f from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:01:50 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:01:50 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:01:50 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:01:50 user nova-compute[74739]:   <serial>6d801d48-7ffd-4afe-abaf-4917ea91a87b</serial>
Oct 25 18:01:50 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 18:01:50 user nova-compute[74739]: </disk>
Oct 25 18:01:50 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba53673-8a65-4821-869c-30ef7f108cad]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:01:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec730700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdb from instance f9569bc3-c6d4-4eb1-9a6f-73549952097f from the persistent domain config.
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9569bc3-c6d4-4eb1-9a6f-73549952097f from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:01:50 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:01:50 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:01:50 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:01:50 user nova-compute[74739]:   <serial>6d801d48-7ffd-4afe-abaf-4917ea91a87b</serial>
Oct 25 18:01:50 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 18:01:50 user nova-compute[74739]: </disk>
Oct 25 18:01:50 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68028699-8ccf-4962-9121-ac8b6e28d2b0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad6cf41-544c-4aff-b97c-0968d1619b00]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3420748-eab7-4e0d-aadb-784304d44dd0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a678e9-8008-498e-8561-b9c9c1479381]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[63931ea0-9856-4067-8a1b-f52ce7bcb2c6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86a785-be6b-48d5-9a82-5005df6b3d39]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260]
Oct 25 18:01:50 user nova-compute[74739]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75, portal: 172.16.0.220,3260] successful.
Oct 25 18:01:50 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13c475e6-2753-4712-8617-bab64e53aa75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3c9114-bb7e-4c40-a7c2-b90c12447d8e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] <== disconnect_volume: return (398ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:01:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:01:51 user nova-compute[74739]: DEBUG nova.objects.instance [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'flavor' on Instance uuid df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:01:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:01:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-87e57f48-65bf-4399-9309-b90d4a2ff16e tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.229s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:01:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:03 user nova-compute[74739]: INFO nova.compute.manager [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Terminating instance
Oct 25 18:02:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e65a839-0bb9-48ba-a724-cf9e9630a56b req-e4417715-0c26-4fe7-81ff-4b8de822f5de service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-unplugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:02:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Instance destroyed successfully.
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.objects.instance [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lazy-loading 'resources' on Instance uuid 3723e87f-01ff-4e0a-aea0-21cbda1530c4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T17:57:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1101093121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1540939192',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT/FZJbygdAuZbe6fPgc+i5QAflFP2jbf7GK/apERl6Ru4fy6nVaW7N0UKexu/ZrsNTPSZJRigPCOJJlSYgdDqu8lU+hmgFFnRQVGH1CN90qYL5bKnNpXOnf/n5mwXriw==',key_name='tempest-keypair-633979250',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d34a9a90a764499bb3e666c8ef83fe22',ramdisk_id='',reservation_id='r-ngfgp0r6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-580492283',owner_user_name='tempest-ServerActionsV293TestJSON-580492283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05983a2b250c415eb66a51571da2facf',uuid=3723e87f-01ff-4e0a-aea0-21cbda1530c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converting VIF {"id": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "address": "fa:16:3e:df:41:8b", "network": {"id": "e5ed0636-0a5a-470b-ae81-208be2ecc51a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-925737251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d34a9a90a764499bb3e666c8ef83fe22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02cc6e2-45", "ovs_interfaceid": "f02cc6e2-452d-4e40-87d1-6d8eaea24266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_vif [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf02cc6e2-45, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3953270e-8699-43f3-a827-d2a66506a52a) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:04 user nova-compute[74739]: INFO os_vif [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:41:8b,bridge_name='br-int',has_traffic_filtering=True,id=f02cc6e2-452d-4e40-87d1-6d8eaea24266,network=Network(e5ed0636-0a5a-470b-ae81-208be2ecc51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02cc6e2-45')
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sHSATLpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:02:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a9380b-1e9c-4248-a306-2c37950eeea9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:02:04 user nova-compute[74739]: No targets found.
Oct 25 18:02:04 user nova-compute[74739]: iSNS:
Oct 25 18:02:04 user nova-compute[74739]: No targets found.
Oct 25 18:02:04 user nova-compute[74739]: STATIC:
Oct 25 18:02:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:02:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2
Oct 25 18:02:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 18:02:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:02:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:04 user nova-compute[74739]: FIRMWARE:
Oct 25 18:02:04 user nova-compute[74739]: No targets found.
Oct 25 18:02:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:02:04 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:02:04 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e05a5c-f97e-4a3a-8202-032767565342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d182fc9-fde2-4959-a12d-e7c3455a102d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:02:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc192ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2'): ({'sdf'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Removing single pathed devices sdf {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ddd60c-9d84-4397-ac31-f035d1723aa7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0300ea-1b6a-4bb7-9371-8c81a7b6d6dc]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Flushing IO for device /dev/sdf {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a7fea-30fc-4397-b0e1-b8672debf724]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eca62a-8698-4e0e-bfdf-d90bed47c2a6]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e72a16d',) {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ace467-1895-46b5-8a1c-e353c64b9d49]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.064s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e3638b-b751-4dcb-91e6-8d0077c48840]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25477e0-49a6-4f32-9e11-195642577942]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260]
Oct 25 18:02:04 user nova-compute[74739]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2, portal: 172.16.0.220,3260] successful.
Oct 25 18:02:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5d58217-3070-43c9-a028-2a6f26a07ef2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df1368-2042-4a66-b95a-ff319b6171e6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] <== disconnect_volume: return (362ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:02:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deleting instance files /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4_del
Oct 25 18:02:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deletion of /opt/stack/data/nova/instances/3723e87f-01ff-4e0a-aea0-21cbda1530c4_del complete
Oct 25 18:02:04 user nova-compute[74739]: INFO nova.compute.manager [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 18:02:04 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:02:04 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:02:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:05 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:05 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Took 0.61 seconds to deallocate network for instance.
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] Acquiring lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] No waiting events found dispatching network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:06 user nova-compute[74739]: WARNING nova.compute.manager [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received unexpected event network-vif-plugged-f02cc6e2-452d-4e40-87d1-6d8eaea24266 for instance with vm_state active and task_state deleting.
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-00b08ac3-93ab-42b8-b44e-93acfdf6c317 req-85fc71ba-9fff-4ce6-9984-0dc6a53144a1 service nova] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Received event network-vif-deleted-f02cc6e2-452d-4e40-87d1-6d8eaea24266 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:06 user nova-compute[74739]: INFO nova.compute.manager [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Took 1.05 seconds to detach 1 volumes for instance.
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] [instance: 3723e87f-01ff-4e0a-aea0-21cbda1530c4] Deleting volume: e5d58217-3070-43c9-a028-2a6f26a07ef2 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:02:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:02:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:07 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Deleted allocations for instance 3723e87f-01ff-4e0a-aea0-21cbda1530c4
Oct 25 18:02:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-10427928-de82-4e77-a693-094a9603c6ee tempest-ServerActionsV293TestJSON-580492283 tempest-ServerActionsV293TestJSON-580492283-project-member] Lock "3723e87f-01ff-4e0a-aea0-21cbda1530c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.430s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9569bc3-c6d4-4eb1-9a6f-73549952097f is timed out.
Oct 25 18:02:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdb from instance f9569bc3-c6d4-4eb1-9a6f-73549952097f from the live domain config.
Oct 25 18:02:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMLTkRVi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:02:10 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[453999ca-2dd0-4506-90b5-aea06de0a6b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:02:10 user nova-compute[74739]: No targets found.
Oct 25 18:02:10 user nova-compute[74739]: iSNS:
Oct 25 18:02:10 user nova-compute[74739]: No targets found.
Oct 25 18:02:10 user nova-compute[74739]: STATIC:
Oct 25 18:02:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:02:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b
Oct 25 18:02:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:10 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:02:10 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:02:10 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:02:10 user nova-compute[74739]: FIRMWARE:
Oct 25 18:02:10 user nova-compute[74739]: No targets found.
Oct 25 18:02:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:02:10 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:02:10 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[790dbb78-cdce-4be9-84a3-cdaba8bf7d71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc5f9b2-d359-47b3-aa80-f7116f22cca3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:02:10 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:02:10 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:02:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:02:10 user nova-compute[74739]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b (non-flash)
Oct 25 18:02:10 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:02:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec5b3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442da92-0e70-4827-a7b5-e264b8422ed9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d4cc09-e1ba-4bb9-aa7d-a3a92b02b442]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfbfd03-8022-4a66-8fff-81bcdc8139ed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:02:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af17f6-9caa-4ce1-9c92-78365e311e63]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a75c51-8f21-47c6-8bff-8d4e58e7b4db]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcec5cb-d31b-41b3-93d1-d150b169ec74]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260]
Oct 25 18:02:11 user nova-compute[74739]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b, portal: 172.16.0.220,3260] successful.
Oct 25 18:02:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d801d48-7ffd-4afe-abaf-4917ea91a87b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af9cbd-282b-4e78-9e07-6d4396a4064d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== disconnect_volume: return (325ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d8afdf27-37be-4256-be61-9d3153bf5417 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.899s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74739) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 25 18:02:12 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:13 user nova-compute[74739]: WARNING nova.compute.manager [req-d9a18fb5-90f6-4d3b-9b4a-44bca3966d5e req-338ea18e-2f3d-4cd4-ab6e-bc9ff9310adc service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state active and task_state powering-off.
Oct 25 18:02:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance destroyed successfully.
Oct 25 18:02:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6bcfad41-faec-42dd-8500-9d844d475b16 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.896s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:14 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:15 user nova-compute[74739]: WARNING nova.compute.manager [req-fcaef2de-c6cc-4611-9322-1c78c7cc26e3 req-31f8f280-5bac-4b7b-afa3-078c68234d94 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state stopped and task_state None.
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:16 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:18 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:02:18 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8023MB free_disk=24.83636474609375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance df989d46-17b2-48b1-bff6-a826b63665d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 0c215818-8652-4adf-8aac-c45847b66df3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:02:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:02:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:02:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-changed-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing instance network info cache due to event network-changed-420593ec-52b2-4b39-bcf8-c657c2448019. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing network info cache for port 420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updated VIF entry in instance network info cache for port 420593ec-52b2-4b39-bcf8-c657c2448019. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d7eb6610-8723-4188-a0a9-37dcd15958ab req-3cf6c691-965a-4d07-b248-17d28038dd84 service nova] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'pci_requests' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:31 user nova-compute[74739]: DEBUG nova.objects.base [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Object Instance<20291d64-e5d7-47f5-8b9c-4e57dd4de314> lazy-loaded attributes: flavor,pci_requests {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:02:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:02:31 user nova-compute[74739]: DEBUG nova.policy [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574f9cf219ae4acf8e807939b600ddfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e75de614674189b1a76798983d3fa7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:02:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Successfully created port: 64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Successfully updated port: 64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-changed-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing instance network info cache due to event network-changed-64c13246-ce39-4fe5-b894-c8f2542e3bfe. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:02:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Refreshing network info cache for port 64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG os_vif [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa81036a-5a30-589b-9865-53a6629b5845', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c13246-ce, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c13246-ce, col_values=(('qos', UUID('f3f6c5fd-66ab-496e-9d70-ec1ae66273c4')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c13246-ce, col_values=(('external_ids', {'iface-id': '64c13246-ce39-4fe5-b894-c8f2542e3bfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:8c:2b', 'vm-uuid': '20291d64-e5d7-47f5-8b9c-4e57dd4de314'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: INFO os_vif [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce')
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] attach device xml: <interface type="ethernet">
Oct 25 18:02:33 user nova-compute[74739]:   <mac address="fa:16:3e:f0:8c:2b"/>
Oct 25 18:02:33 user nova-compute[74739]:   <model type="virtio"/>
Oct 25 18:02:33 user nova-compute[74739]:   <mtu size="1442"/>
Oct 25 18:02:33 user nova-compute[74739]:   <target dev="tap64c13246-ce"/>
Oct 25 18:02:33 user nova-compute[74739]: </interface>
Oct 25 18:02:33 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:33 user nova-compute[74739]: WARNING nova.compute.manager [req-4d020316-79b9-4d49-aff8-b78095f518a7 req-bfd3b7fa-91de-4937-bcf1-cca88e2a5f21 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe for instance with vm_state active and task_state None.
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name hda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:02:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No VIF found with MAC fa:16:3e:82:cc:4e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:02:34 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:02:33</nova:creationTime>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:02:34 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:02:34 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:owner>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:02:34 user nova-compute[74739]:   </nova:owner>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:02:34 user nova-compute[74739]:   <nova:ports>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:02:34 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:02:34 user nova-compute[74739]:     </nova:port>
Oct 25 18:02:34 user nova-compute[74739]:     <nova:port uuid="64c13246-ce39-4fe5-b894-c8f2542e3bfe">
Oct 25 18:02:34 user nova-compute[74739]:       <nova:ip type="fixed" address="10.10.10.35" ipVersion="4"/>
Oct 25 18:02:34 user nova-compute[74739]:     </nova:port>
Oct 25 18:02:34 user nova-compute[74739]:   </nova:ports>
Oct 25 18:02:34 user nova-compute[74739]: </nova:instance>
Oct 25 18:02:34 user nova-compute[74739]:  {{(pid=74739) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-891c43c5-bf56-4348-9423-331cb558ca35 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.228s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updated VIF entry in instance network info cache for port 64c13246-ce39-4fe5-b894-c8f2542e3bfe. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cdc1eec2-7789-42c8-8daf-9f6d6796e2bc req-dbbcb7fa-1f11-413b-af17-7556a0798f79 service nova] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:34 user nova-compute[74739]: INFO nova.compute.manager [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Attaching volume 7ac64adf-e9aa-435d-839c-ad77bd8d4ccd to /dev/vdb
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.utils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d09cb62-8ec2-429d-a328-38a0fb003455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bb2390-d4c1-4a86-be79-fc37d12b9de2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.055s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d537b2-83db-401b-924f-05b489962cc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e5f91-169b-42f7-bb18-b8b14a98fc3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:02:34 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:02:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c62bd70-f983-4381-ad41-d022f59d3237]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG os_brick.utils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:02:34 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating existing volume attachment record: 03e35c97-0b48-4cde-9dac-de15f7b23305 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-changed-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Refreshing instance network info cache due to event network-changed-a702b846-770e-4580-ad3c-51987a59b35b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] Acquiring lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] Acquired lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Refreshing network info cache for port a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updated VIF entry in instance network info cache for port a702b846-770e-4580-ad3c-51987a59b35b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating instance_info_cache with network_info: [{"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-231ea969-44c3-4964-810d-9d7eeed07660 req-98cbae21-9b7f-44d9-bca8-495ca3d4f9dc service nova] Releasing lock "refresh_cache-0c215818-8652-4adf-8aac-c45847b66df3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:35 user nova-compute[74739]: WARNING nova.compute.manager [req-32687e6d-63a1-4a21-9b2b-66a4c43cdd90 req-9ace4a69-6b89-46a7-85d5-2443997ab743 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe for instance with vm_state active and task_state None.
Oct 25 18:02:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:36 user nova-compute[74739]: INFO nova.compute.manager [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attaching volume 7b8c184a-0ee3-4699-9054-b28e0234356e to /dev/vdb
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.utils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f29c7f-b871-4052-87c7-059b918341b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[465fbb67-e083-4be2-936b-cc18e11e2476]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3323e8-818f-4fde-b5ba-801a175e58c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbab68e-d42d-4ce6-abd3-8f3755d6bffe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:02:36 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:02:36 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec8e2d-4b77-4709-ba23-0932055b84ea]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG os_brick.utils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:02:36 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating existing volume attachment record: cb430456-f32f-4b09-981d-d03e5e78ce46 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:02:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:40 user nova-compute[74739]: INFO nova.compute.manager [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Unrescuing
Oct 25 18:02:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:02:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquired lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:02:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Releasing lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'flavor' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:41 user nova-compute[74739]: WARNING nova.compute.manager [req-0bcbc155-5722-4781-9322-65e7dd725bad req-6ab44dab-9d80-45ac-acb5-f8f176cb7e5b service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:02:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance destroyed successfully.
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:43 user nova-compute[74739]: WARNING nova.compute.manager [req-56432f8f-6a80-4f95-b2d1-8c047c162a65 req-4c74e45e-8c7d-463c-9791-e2a1c6b33809 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:45 user nova-compute[74739]: WARNING nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:02:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:45 user nova-compute[74739]: WARNING nova.compute.manager [req-904f6ded-c87f-4618-8b00-de8c30bdfff9 req-ba1e760c-8b88-43a7-98e6-71baf3c46b12 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:02:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b21128b8-770b-47e9-9bda-40e8fc4f564d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:02:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:53 user nova-compute[74739]: INFO nova.compute.manager [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Terminating instance
Oct 25 18:02:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e0e7bfa-552a-43c0-9d03-a20eba46c0db req-ec32bab1-a3ac-4790-8737-6d88b927e19b service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-unplugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:02:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Instance destroyed successfully.
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lazy-loading 'resources' on Instance uuid df989d46-17b2-48b1-bff6-a826b63665d4 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1657899299',display_name='tempest-TestMinimumBasicScenario-server-1657899299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1657899299',id=24,image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsaQA/tBLLRcs3rA5n7445r2XYDfNUVFHOAvJLKB25iLPeqBLf+APn+vYxB9NRX92rQEvzLiYl4FWi0/InNnULHu3rLX186ZjERnW9pbOYy/0BqcyGMD7lX4waWRScPWw==',key_name='tempest-TestMinimumBasicScenario-490274427',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffa01a7434304fa29b2944261e223a3a',ramdisk_id='',reservation_id='r-jdkwnl93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26a8c333-05e1-493a-b2db-8edbb14a87b5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-265773077',owner_user_name='tempest-TestMinimumBasicScenario-265773077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:59:44Z,user_data=None,user_id='6c1ddab8fb434e49b076d09fc47ab457',uuid=df989d46-17b2-48b1-bff6-a826b63665d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converting VIF {"id": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "address": "fa:16:3e:a4:60:38", "network": {"id": "aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1086984254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffa01a7434304fa29b2944261e223a3a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac34d476-39", "ovs_interfaceid": "ac34d476-39cc-4090-b50a-5bc5f0e340a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG os_vif [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac34d476-39, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be61d5fd-94c2-479b-a236-4fd807c7ee83) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:54 user nova-compute[74739]: INFO os_vif [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:60:38,bridge_name='br-int',has_traffic_filtering=True,id=ac34d476-39cc-4090-b50a-5bc5f0e340a1,network=Network(aaefd9b9-3a11-41a7-a98f-7d3dd1ae29a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac34d476-39')
Oct 25 18:02:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Deleting instance files /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4_del
Oct 25 18:02:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Deletion of /opt/stack/data/nova/instances/df989d46-17b2-48b1-bff6-a826b63665d4_del complete
Oct 25 18:02:54 user nova-compute[74739]: INFO nova.compute.manager [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 25 18:02:54 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:02:54 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:02:55 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:02:55 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Took 0.71 seconds to deallocate network for instance.
Oct 25 18:02:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:55 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:02:55 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:02:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:55 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Deleted allocations for instance df989d46-17b2-48b1-bff6-a826b63665d4
Oct 25 18:02:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c5c3e8f7-57ff-4d0c-a15f-790182b86aab tempest-TestMinimumBasicScenario-265773077 tempest-TestMinimumBasicScenario-265773077-project-member] Lock "df989d46-17b2-48b1-bff6-a826b63665d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] Acquiring lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] Lock "df989d46-17b2-48b1-bff6-a826b63665d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] No waiting events found dispatching network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:02:56 user nova-compute[74739]: WARNING nova.compute.manager [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received unexpected event network-vif-plugged-ac34d476-39cc-4090-b50a-5bc5f0e340a1 for instance with vm_state deleted and task_state None.
Oct 25 18:02:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9e38a6b-7d27-4774-bf96-1cc0f298d664 req-23499019-5ff6-40a0-8427-2b2aa188ef68 service nova] [instance: df989d46-17b2-48b1-bff6-a826b63665d4] Received event network-vif-deleted-ac34d476-39cc-4090-b50a-5bc5f0e340a1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:02:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:02:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:03:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPliDmhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:06 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:06 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:06 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8435d076-25b4-49c5-9ae2-42553c064002]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:03:06 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f569310-7158-405f-b5c2-63a9a3a37afc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd] added
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd6824-fba6-4946-b8bd-6457eb791875]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f2fd59-7951-4134-b919-a5b7fba5792a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPliDmhC {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZPliDmhC" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[379843f7-4d7d-49c4-acd9-f442aa11a148]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZPliDmhC'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398247b-5e16-46b9-95ec-ef36e30a31d0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[86be26c5-275c-487b-8125-5740b6ffeec7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ebe487-3bbb-4e92-b50f-9dcfd26e3db0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260]
Oct 25 18:03:06 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260] successful.
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b48aa-a5fa-4e6e-9baa-10f0e4dd4f68]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2819f2-1d3e-4f21-8ebc-56ebb72c7e20]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:06 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e51a26-b724-412b-a9e7-7c0bb18c9fad]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmXrhxdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:07 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPliDmhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26366373336353666', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366373336353666', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.343s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:07 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:07 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe8be2-9ab1-4886-9fca-1fc69fdabb7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:03:07 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b06767-c57f-469b-acd5-154d31ce1f3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e] added
Oct 25 18:03:07 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:03:07 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:07 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:07 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:03:07 user nova-compute[74739]:   <serial>7ac64adf-e9aa-435d-839c-ad77bd8d4ccd</serial>
Oct 25 18:03:07 user nova-compute[74739]: </disk>
Oct 25 18:03:07 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b0d1a-9b43-4ca1-941d-2900bb899b66]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e984541-c3cb-44bd-9c9e-da04b7c586ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmXrhxdK {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kmXrhxdK" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0d23b-9185-4cc6-8c72-fa68ba9585cb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kmXrhxdK'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd889e1-2324-4d82-94f0-92dd651dab20]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[501566ef-0dfe-4221-97ad-e356f3cf2d45]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:07 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:07 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:07 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:07 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:07 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:07 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b180b6bc-2c49-4b74-8350-377344701430]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260]
Oct 25 18:03:07 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260] successful.
Oct 25 18:03:07 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca44cd-f299-4497-ab5f-2bedd5897c30]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf884f6-d674-4ab6-b62a-982ad8068841]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:08 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8fdeb-306f-42a5-bc27-3d2346a26249]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No BDM found with device name hda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] No VIF found with MAC fa:16:3e:82:cc:4e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-50268a17-21a5-4aca-b913-1429f985052c tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.882s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:03:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 2 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:03:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deletion of /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize failed
Oct 25 18:03:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmXrhxdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== connect_volume: return (1673ms) {'type': 'block', 'scsi_wwn': '23839346661376561', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839346661376561', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.objects.instance [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:03:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:09 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:03:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:03:09 user nova-compute[74739]:   <serial>7b8c184a-0ee3-4699-9054-b28e0234356e</serial>
Oct 25 18:03:09 user nova-compute[74739]: </disk>
Oct 25 18:03:09 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No VIF found with MAC fa:16:3e:d0:50:8b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-85353f1a-1111-4544-a4bd-e008e1030bc7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.617s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:09 user nova-compute[74739]: INFO nova.compute.manager [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Detaching volume 7ac64adf-e9aa-435d-839c-ad77bd8d4ccd
Oct 25 18:03:09 user nova-compute[74739]: INFO nova.virt.block_device [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Attempting to driver detach volume 7ac64adf-e9aa-435d-839c-ad77bd8d4ccd from mountpoint /dev/vdb
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Attempting to detach device vdb from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:03:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:09 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:03:09 user nova-compute[74739]:   <serial>7ac64adf-e9aa-435d-839c-ad77bd8d4ccd</serial>
Oct 25 18:03:09 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:03:09 user nova-compute[74739]: </disk>
Oct 25 18:03:09 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully detached device vdb from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the persistent domain config.
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:03:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:03:09 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:09 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:09 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:03:09 user nova-compute[74739]:   <serial>7ac64adf-e9aa-435d-839c-ad77bd8d4ccd</serial>
Oct 25 18:03:09 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:03:09 user nova-compute[74739]: </disk>
Oct 25 18:03:09 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:03:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.objects.instance [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:13 user nova-compute[74739]: INFO nova.compute.manager [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attaching volume 9f406f42-1be1-43ca-93bd-5af0241c446b to /dev/vdc
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.utils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53f3b91-e05e-40a3-9522-47527ba35a20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[823fbcac-5166-4a8d-9436-7de782a8019d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9942cbf-799c-4cb9-a943-a11ba0c97db0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ea806-4dbe-4825-801b-a28f6ddbaee8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updating instance_info_cache with network_info: [{"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:03:13 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e9f2d2-4042-4528-a385-862cb6bc65a1]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG os_brick.utils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating existing volume attachment record: 5fb3387a-7a45-45e1-9aba-1bdd3981c3c7 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-90654bc3-128a-4c50-a106-e919cc201796" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:03:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 90654bc3-128a-4c50-a106-e919cc201796 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3ebb8df7-813e-4118-9689-f56934edf958" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "90654bc3-128a-4c50-a106-e919cc201796" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3ebb8df7-813e-4118-9689-f56934edf958" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "90654bc3-128a-4c50-a106-e919cc201796" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:03:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8182MB free_disk=24.85177993774414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 0c215818-8652-4adf-8aac-c45847b66df3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:03:19 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:03:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.905s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:03:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:03:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:03:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 is timed out.
Oct 25 18:03:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully detached device vdb from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the live domain config.
Oct 25 18:03:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZPliDmhC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc636f-be4a-4758-8b08-8246a2e3d5fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:03:30 user nova-compute[74739]: No targets found.
Oct 25 18:03:30 user nova-compute[74739]: iSNS:
Oct 25 18:03:30 user nova-compute[74739]: No targets found.
Oct 25 18:03:30 user nova-compute[74739]: STATIC:
Oct 25 18:03:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:03:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd
Oct 25 18:03:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e
Oct 25 18:03:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:03:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:30 user nova-compute[74739]: FIRMWARE:
Oct 25 18:03:30 user nova-compute[74739]: No targets found.
Oct 25 18:03:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:03:30 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:03:30 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[30539887-54c5-43f8-bbf1-6cd0f97a69b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e56443a-5b70-402a-a52f-afd567dc8cb7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:30 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec1776d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b088b-7813-42dc-91d8-e51b45399029]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebe8ad9-b06a-4b5f-8553-90f40793f052]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac731e-a447-44b4-bc3f-0b01dd975dc0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2970488-6961-4993-8ec7-ce193e2cf7a5]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4558b6b9-6da3-482f-898a-58dff6884dc0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9244056-3a0b-44f7-b327-49535eb42cf8]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260]
Oct 25 18:03:30 user nova-compute[74739]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd, portal: 172.16.0.220,3260] successful.
Oct 25 18:03:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac64adf-e9aa-435d-839c-ad77bd8d4ccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faf4feb-ac72-4600-a258-d478b61efa28]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] <== disconnect_volume: return (319ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:03:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ca83f3fc-1c53-4bd1-9a9c-c9138a4cefa7 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.956s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.660s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-64c13246-ce39-4fe5-b894-c8f2542e3bfe" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-64c13246-ce39-4fe5-b894-c8f2542e3bfe" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Attempting to detach device tap64c13246-ce from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] detach device xml: <interface type="ethernet">
Oct 25 18:03:32 user nova-compute[74739]:   <mac address="fa:16:3e:f0:8c:2b"/>
Oct 25 18:03:32 user nova-compute[74739]:   <model type="virtio"/>
Oct 25 18:03:32 user nova-compute[74739]:   <mtu size="1442"/>
Oct 25 18:03:32 user nova-compute[74739]:   <target dev="tap64c13246-ce"/>
Oct 25 18:03:32 user nova-compute[74739]: </interface>
Oct 25 18:03:32 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface>not found in domain: <domain type='kvm' id='38'>
Oct 25 18:03:32 user nova-compute[74739]:   <name>instance-0000001c</name>
Oct 25 18:03:32 user nova-compute[74739]:   <uuid>20291d64-e5d7-47f5-8b9c-4e57dd4de314</uuid>
Oct 25 18:03:32 user nova-compute[74739]:   <metadata>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:32 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:02:33</nova:creationTime>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:32 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:32 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:32 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:32 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:32 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:32 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:32 user nova-compute[74739]:     <nova:port uuid="64c13246-ce39-4fe5-b894-c8f2542e3bfe">
Oct 25 18:03:32 user nova-compute[74739]:       <nova:ip type="fixed" address="10.10.10.35" ipVersion="4"/>
Oct 25 18:03:32 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:32 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:32 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:32 user nova-compute[74739]:   </metadata>
Oct 25 18:03:32 user nova-compute[74739]:   <memory unit='KiB'>524288</memory>
Oct 25 18:03:32 user nova-compute[74739]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 18:03:32 user nova-compute[74739]:   <vcpu placement='static'>1</vcpu>
Oct 25 18:03:32 user nova-compute[74739]:   <resource>
Oct 25 18:03:32 user nova-compute[74739]:     <partition>/machine</partition>
Oct 25 18:03:32 user nova-compute[74739]:   </resource>
Oct 25 18:03:32 user nova-compute[74739]:   <sysinfo type='smbios'>
Oct 25 18:03:32 user nova-compute[74739]:     <system>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='version'>0.0.0</entry>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='serial'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='uuid'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:32 user nova-compute[74739]:       <entry name='family'>Virtual Machine</entry>
Oct 25 18:03:32 user nova-compute[74739]:     </system>
Oct 25 18:03:32 user nova-compute[74739]:   </sysinfo>
Oct 25 18:03:32 user nova-compute[74739]:   <os>
Oct 25 18:03:32 user nova-compute[74739]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 18:03:32 user nova-compute[74739]:     <boot dev='hd'/>
Oct 25 18:03:32 user nova-compute[74739]:     <smbios mode='sysinfo'/>
Oct 25 18:03:32 user nova-compute[74739]:   </os>
Oct 25 18:03:32 user nova-compute[74739]:   <features>
Oct 25 18:03:32 user nova-compute[74739]:     <acpi/>
Oct 25 18:03:32 user nova-compute[74739]:     <apic/>
Oct 25 18:03:32 user nova-compute[74739]:     <vmcoreinfo state='on'/>
Oct 25 18:03:32 user nova-compute[74739]:   </features>
Oct 25 18:03:32 user nova-compute[74739]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 18:03:32 user nova-compute[74739]:     <model fallback='forbid'>Nehalem</model>
Oct 25 18:03:32 user nova-compute[74739]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 18:03:32 user nova-compute[74739]:     <feature policy='require' name='vme'/>
Oct 25 18:03:32 user nova-compute[74739]:     <feature policy='require' name='x2apic'/>
Oct 25 18:03:32 user nova-compute[74739]:     <feature policy='require' name='hypervisor'/>
Oct 25 18:03:32 user nova-compute[74739]:   </cpu>
Oct 25 18:03:32 user nova-compute[74739]:   <clock offset='utc'>
Oct 25 18:03:32 user nova-compute[74739]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 18:03:32 user nova-compute[74739]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 18:03:32 user nova-compute[74739]:     <timer name='hpet' present='no'/>
Oct 25 18:03:32 user nova-compute[74739]:   </clock>
Oct 25 18:03:32 user nova-compute[74739]:   <on_poweroff>destroy</on_poweroff>
Oct 25 18:03:32 user nova-compute[74739]:   <on_reboot>restart</on_reboot>
Oct 25 18:03:32 user nova-compute[74739]:   <on_crash>destroy</on_crash>
Oct 25 18:03:32 user nova-compute[74739]:   <devices>
Oct 25 18:03:32 user nova-compute[74739]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 18:03:32 user nova-compute[74739]:     <disk type='file' device='disk'>
Oct 25 18:03:32 user nova-compute[74739]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 18:03:32 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk' index='2'/>
Oct 25 18:03:32 user nova-compute[74739]:       <backingStore type='file' index='3'>
Oct 25 18:03:32 user nova-compute[74739]:         <format type='raw'/>
Oct 25 18:03:32 user nova-compute[74739]:         <source file='/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880'/>
Oct 25 18:03:32 user nova-compute[74739]:         <backingStore/>
Oct 25 18:03:32 user nova-compute[74739]:       </backingStore>
Oct 25 18:03:32 user nova-compute[74739]:       <target dev='vda' bus='virtio'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='virtio-disk0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </disk>
Oct 25 18:03:32 user nova-compute[74739]:     <disk type='file' device='cdrom'>
Oct 25 18:03:32 user nova-compute[74739]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 18:03:32 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config' index='1'/>
Oct 25 18:03:32 user nova-compute[74739]:       <backingStore/>
Oct 25 18:03:32 user nova-compute[74739]:       <target dev='hda' bus='ide'/>
Oct 25 18:03:32 user nova-compute[74739]:       <readonly/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='ide0-0-0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </disk>
Oct 25 18:03:32 user nova-compute[74739]:     <controller type='usb' index='0' model='none'>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='usb'/>
Oct 25 18:03:32 user nova-compute[74739]:     </controller>
Oct 25 18:03:32 user nova-compute[74739]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='pci.0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </controller>
Oct 25 18:03:32 user nova-compute[74739]:     <controller type='ide' index='0'>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='ide'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 18:03:32 user nova-compute[74739]:     </controller>
Oct 25 18:03:32 user nova-compute[74739]:     <interface type='ethernet'>
Oct 25 18:03:32 user nova-compute[74739]:       <mac address='fa:16:3e:82:cc:4e'/>
Oct 25 18:03:32 user nova-compute[74739]:       <target dev='tap420593ec-52'/>
Oct 25 18:03:32 user nova-compute[74739]:       <model type='virtio'/>
Oct 25 18:03:32 user nova-compute[74739]:       <mtu size='1442'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='net0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </interface>
Oct 25 18:03:32 user nova-compute[74739]:     <interface type='ethernet'>
Oct 25 18:03:32 user nova-compute[74739]:       <mac address='fa:16:3e:f0:8c:2b'/>
Oct 25 18:03:32 user nova-compute[74739]:       <target dev='tap64c13246-ce'/>
Oct 25 18:03:32 user nova-compute[74739]:       <model type='virtio'/>
Oct 25 18:03:32 user nova-compute[74739]:       <mtu size='1442'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='net1'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </interface>
Oct 25 18:03:32 user nova-compute[74739]:     <serial type='pty'>
Oct 25 18:03:32 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:32 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:32 user nova-compute[74739]:       <target type='isa-serial' port='0'>
Oct 25 18:03:32 user nova-compute[74739]:         <model name='isa-serial'/>
Oct 25 18:03:32 user nova-compute[74739]:       </target>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </serial>
Oct 25 18:03:32 user nova-compute[74739]:     <console type='pty' tty='/dev/pts/7'>
Oct 25 18:03:32 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:32 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:32 user nova-compute[74739]:       <target type='serial' port='0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </console>
Oct 25 18:03:32 user nova-compute[74739]:     <input type='mouse' bus='ps2'>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='input0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </input>
Oct 25 18:03:32 user nova-compute[74739]:     <input type='keyboard' bus='ps2'>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='input1'/>
Oct 25 18:03:32 user nova-compute[74739]:     </input>
Oct 25 18:03:32 user nova-compute[74739]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 25 18:03:32 user nova-compute[74739]:       <listen type='address' address='0.0.0.0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </graphics>
Oct 25 18:03:32 user nova-compute[74739]:     <audio id='1' type='none'/>
Oct 25 18:03:32 user nova-compute[74739]:     <video>
Oct 25 18:03:32 user nova-compute[74739]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='video0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </video>
Oct 25 18:03:32 user nova-compute[74739]:     <memballoon model='virtio'>
Oct 25 18:03:32 user nova-compute[74739]:       <stats period='10'/>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='balloon0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </memballoon>
Oct 25 18:03:32 user nova-compute[74739]:     <rng model='virtio'>
Oct 25 18:03:32 user nova-compute[74739]:       <backend model='random'>/dev/urandom</backend>
Oct 25 18:03:32 user nova-compute[74739]:       <alias name='rng0'/>
Oct 25 18:03:32 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 18:03:32 user nova-compute[74739]:     </rng>
Oct 25 18:03:32 user nova-compute[74739]:   </devices>
Oct 25 18:03:32 user nova-compute[74739]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 18:03:32 user nova-compute[74739]:     <label>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</label>
Oct 25 18:03:32 user nova-compute[74739]:     <imagelabel>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</imagelabel>
Oct 25 18:03:32 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:32 user nova-compute[74739]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 18:03:32 user nova-compute[74739]:     <label>+64055:+108</label>
Oct 25 18:03:32 user nova-compute[74739]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 18:03:32 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:32 user nova-compute[74739]: </domain>
Oct 25 18:03:32 user nova-compute[74739]:  {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 18:03:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully detached device tap64c13246-ce from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the persistent domain config.
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] (1/8): Attempting to detach device tap64c13246-ce with device alias net1 from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] detach device xml: <interface type="ethernet">
Oct 25 18:03:32 user nova-compute[74739]:   <mac address="fa:16:3e:f0:8c:2b"/>
Oct 25 18:03:32 user nova-compute[74739]:   <model type="virtio"/>
Oct 25 18:03:32 user nova-compute[74739]:   <mtu size="1442"/>
Oct 25 18:03:32 user nova-compute[74739]:   <target dev="tap64c13246-ce"/>
Oct 25 18:03:32 user nova-compute[74739]: </interface>
Oct 25 18:03:32 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJkwqiLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:32 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aff13e-d9d6-4c18-98b6-71d01fa8b822]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:03:32 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a4537-b583-468b-8842-7da9c869fb41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b] added
Oct 25 18:03:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa823cc-e9c7-46bd-936f-79c9b51dd035]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Start waiting for the detach event from libvirt for device tap64c13246-ce with device alias net1 for instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c643baee-5234-4510-bad9-beb201f24241]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YJkwqiLO {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YJkwqiLO" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8b03c-92b4-4101-aea7-0f04ee8515af]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YJkwqiLO'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[18583846-a129-4d06-b9c2-98512e903b6f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde4376-c0b2-40ec-a27a-38d3bdcc3c4d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:32 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:32 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470a348-0cc1-4c03-a18e-77f12bd746bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260]
Oct 25 18:03:33 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260] successful.
Oct 25 18:03:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f136d0c6-409d-4ef1-842c-3b5256d83a07]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b2edb6-c4cc-47d7-8123-a60ebca3496a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)
Oct 25 18:03:33 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd67e9-8a35-423e-abb3-f06a093b1fe1]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-unplugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-unplugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:03:33 user nova-compute[74739]: WARNING nova.compute.manager [req-aab05cf3-efbb-416f-a226-7b04f2390a9d req-b93d9f0a-517a-4edd-a2da-614fa3bbeea3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-unplugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe for instance with vm_state active and task_state None.
Oct 25 18:03:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJkwqiLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23632646566666461', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632646566666461', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:03:34 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:34 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:34 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:03:34 user nova-compute[74739]:   <serial>9f406f42-1be1-43ca-93bd-5af0241c446b</serial>
Oct 25 18:03:34 user nova-compute[74739]: </disk>
Oct 25 18:03:34 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] No VIF found with MAC fa:16:3e:d0:50:8b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-940342f9-cee0-4aa9-b82d-46fdf740755f tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.004s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.687s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:03:35 user nova-compute[74739]: WARNING nova.compute.manager [req-166c3b0c-1174-4d82-a70b-8e5fc4ab6112 req-bd972d36-31dc-4c85-847f-bd0c6e3d3ee6 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-64c13246-ce39-4fe5-b894-c8f2542e3bfe for instance with vm_state active and task_state None.
Oct 25 18:03:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:03:35 user nova-compute[74739]: INFO nova.compute.manager [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Detaching volume 9f406f42-1be1-43ca-93bd-5af0241c446b
Oct 25 18:03:35 user nova-compute[74739]: INFO nova.virt.block_device [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attempting to driver detach volume 9f406f42-1be1-43ca-93bd-5af0241c446b from mountpoint /dev/vdc
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Attempting to detach device vdc from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:03:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:35 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:35 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:03:35 user nova-compute[74739]:   <serial>9f406f42-1be1-43ca-93bd-5af0241c446b</serial>
Oct 25 18:03:35 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:03:35 user nova-compute[74739]: </disk>
Oct 25 18:03:35 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:35 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully detached device vdc from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the persistent domain config.
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:03:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:03:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:03:35 user nova-compute[74739]:   <source dev="/dev/sdc"/>
Oct 25 18:03:35 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:03:35 user nova-compute[74739]:   <serial>9f406f42-1be1-43ca-93bd-5af0241c446b</serial>
Oct 25 18:03:35 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:03:35 user nova-compute[74739]: </disk>
Oct 25 18:03:35 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:03:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:03:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:03:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Waiting for libvirt event about the detach of device tap64c13246-ce with device alias net1 from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 is timed out.
Oct 25 18:03:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface>not found in domain: <domain type='kvm' id='38'>
Oct 25 18:03:52 user nova-compute[74739]:   <name>instance-0000001c</name>
Oct 25 18:03:52 user nova-compute[74739]:   <uuid>20291d64-e5d7-47f5-8b9c-4e57dd4de314</uuid>
Oct 25 18:03:52 user nova-compute[74739]:   <metadata>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:52 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:02:33</nova:creationTime>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:52 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:52 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:52 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:52 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:52 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:52 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:52 user nova-compute[74739]:     <nova:port uuid="64c13246-ce39-4fe5-b894-c8f2542e3bfe">
Oct 25 18:03:52 user nova-compute[74739]:       <nova:ip type="fixed" address="10.10.10.35" ipVersion="4"/>
Oct 25 18:03:52 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:52 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:52 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:52 user nova-compute[74739]:   </metadata>
Oct 25 18:03:52 user nova-compute[74739]:   <memory unit='KiB'>524288</memory>
Oct 25 18:03:52 user nova-compute[74739]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 18:03:52 user nova-compute[74739]:   <vcpu placement='static'>1</vcpu>
Oct 25 18:03:52 user nova-compute[74739]:   <resource>
Oct 25 18:03:52 user nova-compute[74739]:     <partition>/machine</partition>
Oct 25 18:03:52 user nova-compute[74739]:   </resource>
Oct 25 18:03:52 user nova-compute[74739]:   <sysinfo type='smbios'>
Oct 25 18:03:52 user nova-compute[74739]:     <system>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='version'>0.0.0</entry>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='serial'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='uuid'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:52 user nova-compute[74739]:       <entry name='family'>Virtual Machine</entry>
Oct 25 18:03:52 user nova-compute[74739]:     </system>
Oct 25 18:03:52 user nova-compute[74739]:   </sysinfo>
Oct 25 18:03:52 user nova-compute[74739]:   <os>
Oct 25 18:03:52 user nova-compute[74739]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 18:03:52 user nova-compute[74739]:     <boot dev='hd'/>
Oct 25 18:03:52 user nova-compute[74739]:     <smbios mode='sysinfo'/>
Oct 25 18:03:52 user nova-compute[74739]:   </os>
Oct 25 18:03:52 user nova-compute[74739]:   <features>
Oct 25 18:03:52 user nova-compute[74739]:     <acpi/>
Oct 25 18:03:52 user nova-compute[74739]:     <apic/>
Oct 25 18:03:52 user nova-compute[74739]:     <vmcoreinfo state='on'/>
Oct 25 18:03:52 user nova-compute[74739]:   </features>
Oct 25 18:03:52 user nova-compute[74739]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 18:03:52 user nova-compute[74739]:     <model fallback='forbid'>Nehalem</model>
Oct 25 18:03:52 user nova-compute[74739]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 18:03:52 user nova-compute[74739]:     <feature policy='require' name='vme'/>
Oct 25 18:03:52 user nova-compute[74739]:     <feature policy='require' name='x2apic'/>
Oct 25 18:03:52 user nova-compute[74739]:     <feature policy='require' name='hypervisor'/>
Oct 25 18:03:52 user nova-compute[74739]:   </cpu>
Oct 25 18:03:52 user nova-compute[74739]:   <clock offset='utc'>
Oct 25 18:03:52 user nova-compute[74739]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 18:03:52 user nova-compute[74739]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 18:03:52 user nova-compute[74739]:     <timer name='hpet' present='no'/>
Oct 25 18:03:52 user nova-compute[74739]:   </clock>
Oct 25 18:03:52 user nova-compute[74739]:   <on_poweroff>destroy</on_poweroff>
Oct 25 18:03:52 user nova-compute[74739]:   <on_reboot>restart</on_reboot>
Oct 25 18:03:52 user nova-compute[74739]:   <on_crash>destroy</on_crash>
Oct 25 18:03:52 user nova-compute[74739]:   <devices>
Oct 25 18:03:52 user nova-compute[74739]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 18:03:52 user nova-compute[74739]:     <disk type='file' device='disk'>
Oct 25 18:03:52 user nova-compute[74739]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 18:03:52 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk' index='2'/>
Oct 25 18:03:52 user nova-compute[74739]:       <backingStore type='file' index='3'>
Oct 25 18:03:52 user nova-compute[74739]:         <format type='raw'/>
Oct 25 18:03:52 user nova-compute[74739]:         <source file='/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880'/>
Oct 25 18:03:52 user nova-compute[74739]:         <backingStore/>
Oct 25 18:03:52 user nova-compute[74739]:       </backingStore>
Oct 25 18:03:52 user nova-compute[74739]:       <target dev='vda' bus='virtio'/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='virtio-disk0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </disk>
Oct 25 18:03:52 user nova-compute[74739]:     <disk type='file' device='cdrom'>
Oct 25 18:03:52 user nova-compute[74739]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 18:03:52 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config' index='1'/>
Oct 25 18:03:52 user nova-compute[74739]:       <backingStore/>
Oct 25 18:03:52 user nova-compute[74739]:       <target dev='hda' bus='ide'/>
Oct 25 18:03:52 user nova-compute[74739]:       <readonly/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='ide0-0-0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </disk>
Oct 25 18:03:52 user nova-compute[74739]:     <controller type='usb' index='0' model='none'>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='usb'/>
Oct 25 18:03:52 user nova-compute[74739]:     </controller>
Oct 25 18:03:52 user nova-compute[74739]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='pci.0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </controller>
Oct 25 18:03:52 user nova-compute[74739]:     <controller type='ide' index='0'>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='ide'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 18:03:52 user nova-compute[74739]:     </controller>
Oct 25 18:03:52 user nova-compute[74739]:     <interface type='ethernet'>
Oct 25 18:03:52 user nova-compute[74739]:       <mac address='fa:16:3e:82:cc:4e'/>
Oct 25 18:03:52 user nova-compute[74739]:       <target dev='tap420593ec-52'/>
Oct 25 18:03:52 user nova-compute[74739]:       <model type='virtio'/>
Oct 25 18:03:52 user nova-compute[74739]:       <mtu size='1442'/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='net0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </interface>
Oct 25 18:03:52 user nova-compute[74739]:     <serial type='pty'>
Oct 25 18:03:52 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:52 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:52 user nova-compute[74739]:       <target type='isa-serial' port='0'>
Oct 25 18:03:52 user nova-compute[74739]:         <model name='isa-serial'/>
Oct 25 18:03:52 user nova-compute[74739]:       </target>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </serial>
Oct 25 18:03:52 user nova-compute[74739]:     <console type='pty' tty='/dev/pts/7'>
Oct 25 18:03:52 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:52 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:52 user nova-compute[74739]:       <target type='serial' port='0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </console>
Oct 25 18:03:52 user nova-compute[74739]:     <input type='mouse' bus='ps2'>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='input0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </input>
Oct 25 18:03:52 user nova-compute[74739]:     <input type='keyboard' bus='ps2'>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='input1'/>
Oct 25 18:03:52 user nova-compute[74739]:     </input>
Oct 25 18:03:52 user nova-compute[74739]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 25 18:03:52 user nova-compute[74739]:       <listen type='address' address='0.0.0.0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </graphics>
Oct 25 18:03:52 user nova-compute[74739]:     <audio id='1' type='none'/>
Oct 25 18:03:52 user nova-compute[74739]:     <video>
Oct 25 18:03:52 user nova-compute[74739]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='video0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </video>
Oct 25 18:03:52 user nova-compute[74739]:     <memballoon model='virtio'>
Oct 25 18:03:52 user nova-compute[74739]:       <stats period='10'/>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='balloon0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </memballoon>
Oct 25 18:03:52 user nova-compute[74739]:     <rng model='virtio'>
Oct 25 18:03:52 user nova-compute[74739]:       <backend model='random'>/dev/urandom</backend>
Oct 25 18:03:52 user nova-compute[74739]:       <alias name='rng0'/>
Oct 25 18:03:52 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 18:03:52 user nova-compute[74739]:     </rng>
Oct 25 18:03:52 user nova-compute[74739]:   </devices>
Oct 25 18:03:52 user nova-compute[74739]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 18:03:52 user nova-compute[74739]:     <label>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</label>
Oct 25 18:03:52 user nova-compute[74739]:     <imagelabel>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</imagelabel>
Oct 25 18:03:52 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:52 user nova-compute[74739]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 18:03:52 user nova-compute[74739]:     <label>+64055:+108</label>
Oct 25 18:03:52 user nova-compute[74739]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 18:03:52 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:52 user nova-compute[74739]: </domain>
Oct 25 18:03:52 user nova-compute[74739]:  {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 18:03:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully detached device tap64c13246-ce from instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 from the live domain config.
Oct 25 18:03:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG os_vif [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c13246-ce, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3f6c5fd-66ab-496e-9d70-ec1ae66273c4) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:53 user nova-compute[74739]: INFO os_vif [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce')
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:53 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:03:53</nova:creationTime>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:53 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:53 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:53 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:53 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:53 user nova-compute[74739]:  {{(pid=74739) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-deleted-64c13246-ce39-4fe5-b894-c8f2542e3bfe {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:03:53 user nova-compute[74739]: INFO nova.compute.manager [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Neutron deleted interface 64c13246-ce39-4fe5-b894-c8f2542e3bfe; detaching it from the instance and deleting it from the info cache
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.objects.instance [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Lazy-loading 'system_metadata' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquired lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.objects.instance [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Lazy-loading 'flavor' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.objects.base [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Object Instance<20291d64-e5d7-47f5-8b9c-4e57dd4de314> lazy-loaded attributes: system_metadata,flavor {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface>not found in domain: <domain type='kvm' id='38'>
Oct 25 18:03:53 user nova-compute[74739]:   <name>instance-0000001c</name>
Oct 25 18:03:53 user nova-compute[74739]:   <uuid>20291d64-e5d7-47f5-8b9c-4e57dd4de314</uuid>
Oct 25 18:03:53 user nova-compute[74739]:   <metadata>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:53 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:03:53</nova:creationTime>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:53 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:53 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:53 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:53 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:53 user nova-compute[74739]:   </metadata>
Oct 25 18:03:53 user nova-compute[74739]:   <memory unit='KiB'>524288</memory>
Oct 25 18:03:53 user nova-compute[74739]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 18:03:53 user nova-compute[74739]:   <vcpu placement='static'>1</vcpu>
Oct 25 18:03:53 user nova-compute[74739]:   <resource>
Oct 25 18:03:53 user nova-compute[74739]:     <partition>/machine</partition>
Oct 25 18:03:53 user nova-compute[74739]:   </resource>
Oct 25 18:03:53 user nova-compute[74739]:   <sysinfo type='smbios'>
Oct 25 18:03:53 user nova-compute[74739]:     <system>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='version'>0.0.0</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='serial'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='uuid'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='family'>Virtual Machine</entry>
Oct 25 18:03:53 user nova-compute[74739]:     </system>
Oct 25 18:03:53 user nova-compute[74739]:   </sysinfo>
Oct 25 18:03:53 user nova-compute[74739]:   <os>
Oct 25 18:03:53 user nova-compute[74739]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 18:03:53 user nova-compute[74739]:     <boot dev='hd'/>
Oct 25 18:03:53 user nova-compute[74739]:     <smbios mode='sysinfo'/>
Oct 25 18:03:53 user nova-compute[74739]:   </os>
Oct 25 18:03:53 user nova-compute[74739]:   <features>
Oct 25 18:03:53 user nova-compute[74739]:     <acpi/>
Oct 25 18:03:53 user nova-compute[74739]:     <apic/>
Oct 25 18:03:53 user nova-compute[74739]:     <vmcoreinfo state='on'/>
Oct 25 18:03:53 user nova-compute[74739]:   </features>
Oct 25 18:03:53 user nova-compute[74739]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 18:03:53 user nova-compute[74739]:     <model fallback='forbid'>Nehalem</model>
Oct 25 18:03:53 user nova-compute[74739]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='vme'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='x2apic'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='hypervisor'/>
Oct 25 18:03:53 user nova-compute[74739]:   </cpu>
Oct 25 18:03:53 user nova-compute[74739]:   <clock offset='utc'>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='hpet' present='no'/>
Oct 25 18:03:53 user nova-compute[74739]:   </clock>
Oct 25 18:03:53 user nova-compute[74739]:   <on_poweroff>destroy</on_poweroff>
Oct 25 18:03:53 user nova-compute[74739]:   <on_reboot>restart</on_reboot>
Oct 25 18:03:53 user nova-compute[74739]:   <on_crash>destroy</on_crash>
Oct 25 18:03:53 user nova-compute[74739]:   <devices>
Oct 25 18:03:53 user nova-compute[74739]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 18:03:53 user nova-compute[74739]:     <disk type='file' device='disk'>
Oct 25 18:03:53 user nova-compute[74739]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 18:03:53 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk' index='2'/>
Oct 25 18:03:53 user nova-compute[74739]:       <backingStore type='file' index='3'>
Oct 25 18:03:53 user nova-compute[74739]:         <format type='raw'/>
Oct 25 18:03:53 user nova-compute[74739]:         <source file='/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880'/>
Oct 25 18:03:53 user nova-compute[74739]:         <backingStore/>
Oct 25 18:03:53 user nova-compute[74739]:       </backingStore>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='vda' bus='virtio'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='virtio-disk0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </disk>
Oct 25 18:03:53 user nova-compute[74739]:     <disk type='file' device='cdrom'>
Oct 25 18:03:53 user nova-compute[74739]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 18:03:53 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config' index='1'/>
Oct 25 18:03:53 user nova-compute[74739]:       <backingStore/>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='hda' bus='ide'/>
Oct 25 18:03:53 user nova-compute[74739]:       <readonly/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='ide0-0-0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </disk>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='usb' index='0' model='none'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='usb'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='pci.0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='ide' index='0'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='ide'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <interface type='ethernet'>
Oct 25 18:03:53 user nova-compute[74739]:       <mac address='fa:16:3e:82:cc:4e'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='tap420593ec-52'/>
Oct 25 18:03:53 user nova-compute[74739]:       <model type='virtio'/>
Oct 25 18:03:53 user nova-compute[74739]:       <mtu size='1442'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='net0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </interface>
Oct 25 18:03:53 user nova-compute[74739]:     <serial type='pty'>
Oct 25 18:03:53 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:53 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target type='isa-serial' port='0'>
Oct 25 18:03:53 user nova-compute[74739]:         <model name='isa-serial'/>
Oct 25 18:03:53 user nova-compute[74739]:       </target>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </serial>
Oct 25 18:03:53 user nova-compute[74739]:     <console type='pty' tty='/dev/pts/7'>
Oct 25 18:03:53 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:53 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target type='serial' port='0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </console>
Oct 25 18:03:53 user nova-compute[74739]:     <input type='mouse' bus='ps2'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='input0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </input>
Oct 25 18:03:53 user nova-compute[74739]:     <input type='keyboard' bus='ps2'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='input1'/>
Oct 25 18:03:53 user nova-compute[74739]:     </input>
Oct 25 18:03:53 user nova-compute[74739]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 25 18:03:53 user nova-compute[74739]:       <listen type='address' address='0.0.0.0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </graphics>
Oct 25 18:03:53 user nova-compute[74739]:     <audio id='1' type='none'/>
Oct 25 18:03:53 user nova-compute[74739]:     <video>
Oct 25 18:03:53 user nova-compute[74739]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='video0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </video>
Oct 25 18:03:53 user nova-compute[74739]:     <memballoon model='virtio'>
Oct 25 18:03:53 user nova-compute[74739]:       <stats period='10'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='balloon0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </memballoon>
Oct 25 18:03:53 user nova-compute[74739]:     <rng model='virtio'>
Oct 25 18:03:53 user nova-compute[74739]:       <backend model='random'>/dev/urandom</backend>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='rng0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </rng>
Oct 25 18:03:53 user nova-compute[74739]:   </devices>
Oct 25 18:03:53 user nova-compute[74739]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 18:03:53 user nova-compute[74739]:     <label>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</label>
Oct 25 18:03:53 user nova-compute[74739]:     <imagelabel>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</imagelabel>
Oct 25 18:03:53 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:53 user nova-compute[74739]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 18:03:53 user nova-compute[74739]:     <label>+64055:+108</label>
Oct 25 18:03:53 user nova-compute[74739]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 18:03:53 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:53 user nova-compute[74739]: </domain>
Oct 25 18:03:53 user nova-compute[74739]:  {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface> {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f0:8c:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tap64c13246-ce"/></interface>not found in domain: <domain type='kvm' id='38'>
Oct 25 18:03:53 user nova-compute[74739]:   <name>instance-0000001c</name>
Oct 25 18:03:53 user nova-compute[74739]:   <uuid>20291d64-e5d7-47f5-8b9c-4e57dd4de314</uuid>
Oct 25 18:03:53 user nova-compute[74739]:   <metadata>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:53 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:03:53</nova:creationTime>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:53 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:53 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:53 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:53 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:53 user nova-compute[74739]:   </metadata>
Oct 25 18:03:53 user nova-compute[74739]:   <memory unit='KiB'>524288</memory>
Oct 25 18:03:53 user nova-compute[74739]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 25 18:03:53 user nova-compute[74739]:   <vcpu placement='static'>1</vcpu>
Oct 25 18:03:53 user nova-compute[74739]:   <resource>
Oct 25 18:03:53 user nova-compute[74739]:     <partition>/machine</partition>
Oct 25 18:03:53 user nova-compute[74739]:   </resource>
Oct 25 18:03:53 user nova-compute[74739]:   <sysinfo type='smbios'>
Oct 25 18:03:53 user nova-compute[74739]:     <system>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='product'>OpenStack Nova</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='version'>0.0.0</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='serial'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='uuid'>20291d64-e5d7-47f5-8b9c-4e57dd4de314</entry>
Oct 25 18:03:53 user nova-compute[74739]:       <entry name='family'>Virtual Machine</entry>
Oct 25 18:03:53 user nova-compute[74739]:     </system>
Oct 25 18:03:53 user nova-compute[74739]:   </sysinfo>
Oct 25 18:03:53 user nova-compute[74739]:   <os>
Oct 25 18:03:53 user nova-compute[74739]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 25 18:03:53 user nova-compute[74739]:     <boot dev='hd'/>
Oct 25 18:03:53 user nova-compute[74739]:     <smbios mode='sysinfo'/>
Oct 25 18:03:53 user nova-compute[74739]:   </os>
Oct 25 18:03:53 user nova-compute[74739]:   <features>
Oct 25 18:03:53 user nova-compute[74739]:     <acpi/>
Oct 25 18:03:53 user nova-compute[74739]:     <apic/>
Oct 25 18:03:53 user nova-compute[74739]:     <vmcoreinfo state='on'/>
Oct 25 18:03:53 user nova-compute[74739]:   </features>
Oct 25 18:03:53 user nova-compute[74739]:   <cpu mode='custom' match='exact' check='full'>
Oct 25 18:03:53 user nova-compute[74739]:     <model fallback='forbid'>Nehalem</model>
Oct 25 18:03:53 user nova-compute[74739]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='vme'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='x2apic'/>
Oct 25 18:03:53 user nova-compute[74739]:     <feature policy='require' name='hypervisor'/>
Oct 25 18:03:53 user nova-compute[74739]:   </cpu>
Oct 25 18:03:53 user nova-compute[74739]:   <clock offset='utc'>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='pit' tickpolicy='delay'/>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 25 18:03:53 user nova-compute[74739]:     <timer name='hpet' present='no'/>
Oct 25 18:03:53 user nova-compute[74739]:   </clock>
Oct 25 18:03:53 user nova-compute[74739]:   <on_poweroff>destroy</on_poweroff>
Oct 25 18:03:53 user nova-compute[74739]:   <on_reboot>restart</on_reboot>
Oct 25 18:03:53 user nova-compute[74739]:   <on_crash>destroy</on_crash>
Oct 25 18:03:53 user nova-compute[74739]:   <devices>
Oct 25 18:03:53 user nova-compute[74739]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 25 18:03:53 user nova-compute[74739]:     <disk type='file' device='disk'>
Oct 25 18:03:53 user nova-compute[74739]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 25 18:03:53 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk' index='2'/>
Oct 25 18:03:53 user nova-compute[74739]:       <backingStore type='file' index='3'>
Oct 25 18:03:53 user nova-compute[74739]:         <format type='raw'/>
Oct 25 18:03:53 user nova-compute[74739]:         <source file='/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880'/>
Oct 25 18:03:53 user nova-compute[74739]:         <backingStore/>
Oct 25 18:03:53 user nova-compute[74739]:       </backingStore>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='vda' bus='virtio'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='virtio-disk0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </disk>
Oct 25 18:03:53 user nova-compute[74739]:     <disk type='file' device='cdrom'>
Oct 25 18:03:53 user nova-compute[74739]:       <driver name='qemu' type='raw' cache='none'/>
Oct 25 18:03:53 user nova-compute[74739]:       <source file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk.config' index='1'/>
Oct 25 18:03:53 user nova-compute[74739]:       <backingStore/>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='hda' bus='ide'/>
Oct 25 18:03:53 user nova-compute[74739]:       <readonly/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='ide0-0-0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </disk>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='usb' index='0' model='none'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='usb'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='pci' index='0' model='pci-root'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='pci.0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <controller type='ide' index='0'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='ide'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 25 18:03:53 user nova-compute[74739]:     </controller>
Oct 25 18:03:53 user nova-compute[74739]:     <interface type='ethernet'>
Oct 25 18:03:53 user nova-compute[74739]:       <mac address='fa:16:3e:82:cc:4e'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target dev='tap420593ec-52'/>
Oct 25 18:03:53 user nova-compute[74739]:       <model type='virtio'/>
Oct 25 18:03:53 user nova-compute[74739]:       <mtu size='1442'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='net0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </interface>
Oct 25 18:03:53 user nova-compute[74739]:     <serial type='pty'>
Oct 25 18:03:53 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:53 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target type='isa-serial' port='0'>
Oct 25 18:03:53 user nova-compute[74739]:         <model name='isa-serial'/>
Oct 25 18:03:53 user nova-compute[74739]:       </target>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </serial>
Oct 25 18:03:53 user nova-compute[74739]:     <console type='pty' tty='/dev/pts/7'>
Oct 25 18:03:53 user nova-compute[74739]:       <source path='/dev/pts/7'/>
Oct 25 18:03:53 user nova-compute[74739]:       <log file='/opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/console.log' append='off'/>
Oct 25 18:03:53 user nova-compute[74739]:       <target type='serial' port='0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='serial0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </console>
Oct 25 18:03:53 user nova-compute[74739]:     <input type='mouse' bus='ps2'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='input0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </input>
Oct 25 18:03:53 user nova-compute[74739]:     <input type='keyboard' bus='ps2'>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='input1'/>
Oct 25 18:03:53 user nova-compute[74739]:     </input>
Oct 25 18:03:53 user nova-compute[74739]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 25 18:03:53 user nova-compute[74739]:       <listen type='address' address='0.0.0.0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </graphics>
Oct 25 18:03:53 user nova-compute[74739]:     <audio id='1' type='none'/>
Oct 25 18:03:53 user nova-compute[74739]:     <video>
Oct 25 18:03:53 user nova-compute[74739]:       <model type='virtio' heads='1' primary='yes'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='video0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </video>
Oct 25 18:03:53 user nova-compute[74739]:     <memballoon model='virtio'>
Oct 25 18:03:53 user nova-compute[74739]:       <stats period='10'/>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='balloon0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </memballoon>
Oct 25 18:03:53 user nova-compute[74739]:     <rng model='virtio'>
Oct 25 18:03:53 user nova-compute[74739]:       <backend model='random'>/dev/urandom</backend>
Oct 25 18:03:53 user nova-compute[74739]:       <alias name='rng0'/>
Oct 25 18:03:53 user nova-compute[74739]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 25 18:03:53 user nova-compute[74739]:     </rng>
Oct 25 18:03:53 user nova-compute[74739]:   </devices>
Oct 25 18:03:53 user nova-compute[74739]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 25 18:03:53 user nova-compute[74739]:     <label>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</label>
Oct 25 18:03:53 user nova-compute[74739]:     <imagelabel>libvirt-20291d64-e5d7-47f5-8b9c-4e57dd4de314</imagelabel>
Oct 25 18:03:53 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:53 user nova-compute[74739]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 25 18:03:53 user nova-compute[74739]:     <label>+64055:+108</label>
Oct 25 18:03:53 user nova-compute[74739]:     <imagelabel>+64055:+108</imagelabel>
Oct 25 18:03:53 user nova-compute[74739]:   </seclabel>
Oct 25 18:03:53 user nova-compute[74739]: </domain>
Oct 25 18:03:53 user nova-compute[74739]:  {{(pid=74739) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 25 18:03:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Detaching interface fa:16:3e:f0:8c:2b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap64c13246-ce' not found.
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Converting VIF {"id": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "address": "fa:16:3e:f0:8c:2b", "network": {"id": "d97880e9-369b-4760-bd12-b0845ba1d173", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-394710753", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c13246-ce", "ovs_interfaceid": "64c13246-ce39-4fe5-b894-c8f2542e3bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG os_vif [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c13246-ce, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:03:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:03:53 user nova-compute[74739]: INFO os_vif [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:8c:2b,bridge_name='br-int',has_traffic_filtering=True,id=64c13246-ce39-4fe5-b894-c8f2542e3bfe,network=Network(d97880e9-369b-4760-bd12-b0845ba1d173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c13246-ce')
Oct 25 18:03:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [req-b6124c27-c191-4c18-9400-63b21d9581ea req-99cfaeff-4153-450a-ad3c-73555cff37ec service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:03:53 user nova-compute[74739]:   <nova:package version="0.0.0"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:name>tempest-device-tagging-server-469969739</nova:name>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:creationTime>2023-10-25 18:03:53</nova:creationTime>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:flavor name="m1.tiny">
Oct 25 18:03:53 user nova-compute[74739]:     <nova:memory>512</nova:memory>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:disk>1</nova:disk>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:swap>0</nova:swap>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:vcpus>1</nova:vcpus>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:flavor>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:user uuid="574f9cf219ae4acf8e807939b600ddfa">tempest-TaggedAttachmentsTest-1505841200-project-member</nova:user>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:project uuid="32e75de614674189b1a76798983d3fa7">tempest-TaggedAttachmentsTest-1505841200</nova:project>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:owner>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:03:53 user nova-compute[74739]:   <nova:ports>
Oct 25 18:03:53 user nova-compute[74739]:     <nova:port uuid="420593ec-52b2-4b39-bcf8-c657c2448019">
Oct 25 18:03:53 user nova-compute[74739]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:03:53 user nova-compute[74739]:     </nova:port>
Oct 25 18:03:53 user nova-compute[74739]:   </nova:ports>
Oct 25 18:03:53 user nova-compute[74739]: </nova:instance>
Oct 25 18:03:53 user nova-compute[74739]:  {{(pid=74739) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 25 18:03:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [{"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:03:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Releasing lock "refresh_cache-20291d64-e5d7-47f5-8b9c-4e57dd4de314" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:03:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-072f24b5-0239-4c89-bc04-a6a3301248a8 tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "interface-20291d64-e5d7-47f5-8b9c-4e57dd4de314-64c13246-ce39-4fe5-b894-c8f2542e3bfe" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.782s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 0c215818-8652-4adf-8aac-c45847b66df3 is timed out.
Oct 25 18:03:56 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully detached device vdc from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the live domain config.
Oct 25 18:03:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YJkwqiLO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:03:56 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7cac18-bb53-45f4-a9c4-d80d79833f28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:03:56 user nova-compute[74739]: No targets found.
Oct 25 18:03:56 user nova-compute[74739]: iSNS:
Oct 25 18:03:56 user nova-compute[74739]: No targets found.
Oct 25 18:03:56 user nova-compute[74739]: STATIC:
Oct 25 18:03:56 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:03:56 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:56 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:56 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e
Oct 25 18:03:56 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:56 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:56 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b
Oct 25 18:03:56 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:56 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:56 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:03:56 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:03:56 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:03:56 user nova-compute[74739]: FIRMWARE:
Oct 25 18:03:56 user nova-compute[74739]: No targets found.
Oct 25 18:03:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:03:56 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:03:56 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca947d-ef39-47bb-9f10-8d2dc6bf34ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91b636c-50ab-4472-a925-b387974b4c05]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b (non-flash)
Oct 25 18:03:56 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:03:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc32edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952d97c-d224-4ad6-9e73-5ab905de8b66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b61e22-9fff-463e-b1b6-b41bc3c6fc6e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f42826-761c-4d63-8fc8-b26d21db7b15]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1fe323-1d27-45b7-b0db-2b0359953acd]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546bdec-26dd-48f8-bfe2-540bddba6d7f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763846a-5d26-45d3-b801-dcfb9b348f42]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260]
Oct 25 18:03:56 user nova-compute[74739]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b, portal: 172.16.0.220,3260] successful.
Oct 25 18:03:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f406f42-1be1-43ca-93bd-5af0241c446b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[422c38a2-53c1-4892-9718-467785d4d92a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== disconnect_volume: return (355ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:03:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:03:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:03:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-83fb2041-efcd-46cf-b964-3d71b8d26171 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:03:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:03:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquired lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG nova.network.neutron [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'info_cache' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.network.neutron [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Releasing lock "refresh_cache-f9569bc3-c6d4-4eb1-9a6f-73549952097f" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:04:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance destroyed successfully.
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'resources' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG os_vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb50c4378-46, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77c11a2d-9a90-4e3a-a0c0-de27d09316f4) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:05 user nova-compute[74739]: INFO os_vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start _get_guest_xml network_info=[{"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'numa_topology' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:05 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:05 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'pci_devices' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:04:05 user nova-compute[74739]:   <uuid>f9569bc3-c6d4-4eb1-9a6f-73549952097f</uuid>
Oct 25 18:04:05 user nova-compute[74739]:   <name>instance-00000015</name>
Oct 25 18:04:05 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:04:05 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:04:05 user nova-compute[74739]:   <metadata>
Oct 25 18:04:05 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:04:05 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeTestJSON-server-1114405803</nova:name>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:04:05</nova:creationTime>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:04:05 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:04:05 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:owner>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:user uuid="73137a888d964149abda3bcac8293e01">tempest-AttachVolumeTestJSON-1878388259-project-member</nova:user>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:project uuid="1631249d25ff403daae6c41e03fd040f">tempest-AttachVolumeTestJSON-1878388259</nova:project>
Oct 25 18:04:05 user nova-compute[74739]:       </nova:owner>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:04:05 user nova-compute[74739]:       <nova:ports>
Oct 25 18:04:05 user nova-compute[74739]:         <nova:port uuid="b50c4378-46f7-449b-8c0b-1c4082488139">
Oct 25 18:04:05 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 18:04:05 user nova-compute[74739]:         </nova:port>
Oct 25 18:04:05 user nova-compute[74739]:       </nova:ports>
Oct 25 18:04:05 user nova-compute[74739]:     </nova:instance>
Oct 25 18:04:05 user nova-compute[74739]:   </metadata>
Oct 25 18:04:05 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:04:05 user nova-compute[74739]:     <system>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="serial">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="uuid">f9569bc3-c6d4-4eb1-9a6f-73549952097f</entry>
Oct 25 18:04:05 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:04:05 user nova-compute[74739]:     </system>
Oct 25 18:04:05 user nova-compute[74739]:   </sysinfo>
Oct 25 18:04:05 user nova-compute[74739]:   <os>
Oct 25 18:04:05 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:04:05 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:04:05 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:04:05 user nova-compute[74739]:   </os>
Oct 25 18:04:05 user nova-compute[74739]:   <features>
Oct 25 18:04:05 user nova-compute[74739]:     <acpi/>
Oct 25 18:04:05 user nova-compute[74739]:     <apic/>
Oct 25 18:04:05 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:04:05 user nova-compute[74739]:   </features>
Oct 25 18:04:05 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:04:05 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:04:05 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:04:05 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:04:05 user nova-compute[74739]:   </clock>
Oct 25 18:04:05 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:04:05 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:04:05 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:04:05 user nova-compute[74739]:   </cpu>
Oct 25 18:04:05 user nova-compute[74739]:   <devices>
Oct 25 18:04:05 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:04:05 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:04:05 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk"/>
Oct 25 18:04:05 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:04:05 user nova-compute[74739]:     </disk>
Oct 25 18:04:05 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:04:05 user nova-compute[74739]:       <mac address="fa:16:3e:15:58:53"/>
Oct 25 18:04:05 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:04:05 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:04:05 user nova-compute[74739]:       <target dev="tapb50c4378-46"/>
Oct 25 18:04:05 user nova-compute[74739]:     </interface>
Oct 25 18:04:05 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:04:05 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/console.log" append="off"/>
Oct 25 18:04:05 user nova-compute[74739]:     </serial>
Oct 25 18:04:05 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:04:05 user nova-compute[74739]:     <video>
Oct 25 18:04:05 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:04:05 user nova-compute[74739]:     </video>
Oct 25 18:04:05 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:04:05 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:04:05 user nova-compute[74739]:     </rng>
Oct 25 18:04:05 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:04:05 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:04:05 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:04:05 user nova-compute[74739]:     </memballoon>
Oct 25 18:04:05 user nova-compute[74739]:   </devices>
Oct 25 18:04:05 user nova-compute[74739]: </domain>
Oct 25 18:04:05 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.217s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Cannot resize image /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'migration_context' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.objects.base [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Object Instance<f9569bc3-c6d4-4eb1-9a6f-73549952097f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG os_vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86b17e61-f3fb-5ffe-8298-fdc487a5a85c', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb50c4378-46, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb50c4378-46, col_values=(('qos', UUID('3eef927d-7312-4c47-8520-198af6b99ab2')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb50c4378-46, col_values=(('external_ids', {'iface-id': 'b50c4378-46f7-449b-8c0b-1c4082488139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:58:53', 'vm-uuid': 'f9569bc3-c6d4-4eb1-9a6f-73549952097f'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:06 user nova-compute[74739]: INFO os_vif [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 18:04:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:04:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance rebooted successfully.
Oct 25 18:04:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-abbf3f9c-702d-485a-8103-41e15c57a589 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:04:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:12 user nova-compute[74739]: WARNING nova.compute.manager [req-899b4d95-3f5d-4072-a1ba-13237987ca71 req-d67d032d-a8b6-4c52-9369-09eb1615bcec service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state active and task_state None.
Oct 25 18:04:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:14 user nova-compute[74739]: WARNING nova.compute.manager [req-85c3fd6d-b066-4fa9-abbd-b48411fa28d8 req-6115775f-b6cd-4c50-9a41-aaf5e53e9eaa service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state active and task_state None.
Oct 25 18:04:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [{"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-eff7760a-3bdd-4322-bb7d-8bd9ad669a14" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:04:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:16 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:18 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:04:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8178MB free_disk=24.885665893554688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 0c215818-8652-4adf-8aac-c45847b66df3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:04:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:23 user nova-compute[74739]: INFO nova.compute.manager [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Terminating instance
Oct 25 18:04:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-unplugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-unplugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-682d14ab-f25d-49eb-8538-3a86864e3488 req-0c1af0e4-1f16-498c-9162-3605e09b8990 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-unplugged-420593ec-52b2-4b39-bcf8-c657c2448019 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:04:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Instance destroyed successfully.
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lazy-loading 'resources' on Instance uuid 20291d64-e5d7-47f5-8b9c-4e57dd4de314 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-25T18:00:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-469969739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-469969739',id=28,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK8AKYABYpLW88UItUARuPWLE1ihgO9WLizc9f7Mphte+cmKax43vMa1s4UEeHknk+2NjqHOrNLO7aVnfubSLXLLRDTaysE8SQk6dmdu8fe24RYoQssQukclpYlhBRUUg==',key_name='tempest-keypair-706056853',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e75de614674189b1a76798983d3fa7',ramdisk_id='',reservation_id='r-1nd0gm8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1505841200',owner_user_name='tempest-TaggedAttachmentsTest-1505841200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574f9cf219ae4acf8e807939b600ddfa',uuid=20291d64-e5d7-47f5-8b9c-4e57dd4de314,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converting VIF {"id": "420593ec-52b2-4b39-bcf8-c657c2448019", "address": "fa:16:3e:82:cc:4e", "network": {"id": "b82c9ed4-f730-4799-a175-ebd53559b247", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1719629534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32e75de614674189b1a76798983d3fa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap420593ec-52", "ovs_interfaceid": "420593ec-52b2-4b39-bcf8-c657c2448019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG os_vif [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap420593ec-52, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca933bd6-f825-4dc4-b60c-1b5a89b3ecb2) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:24 user nova-compute[74739]: INFO os_vif [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:cc:4e,bridge_name='br-int',has_traffic_filtering=True,id=420593ec-52b2-4b39-bcf8-c657c2448019,network=Network(b82c9ed4-f730-4799-a175-ebd53559b247),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap420593ec-52')
Oct 25 18:04:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Deleting instance files /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314_del
Oct 25 18:04:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Deletion of /opt/stack/data/nova/instances/20291d64-e5d7-47f5-8b9c-4e57dd4de314_del complete
Oct 25 18:04:24 user nova-compute[74739]: INFO nova.compute.manager [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 18:04:24 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:04:24 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:24 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Took 0.83 seconds to deallocate network for instance.
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:25 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Deleted allocations for instance 20291d64-e5d7-47f5-8b9c-4e57dd4de314
Oct 25 18:04:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b7e52862-1d2a-4a87-b621-5735201495ec tempest-TaggedAttachmentsTest-1505841200 tempest-TaggedAttachmentsTest-1505841200-project-member] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] Acquiring lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] Lock "20291d64-e5d7-47f5-8b9c-4e57dd4de314-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] No waiting events found dispatching network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:25 user nova-compute[74739]: WARNING nova.compute.manager [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received unexpected event network-vif-plugged-420593ec-52b2-4b39-bcf8-c657c2448019 for instance with vm_state deleted and task_state None.
Oct 25 18:04:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-c180b42a-1619-4d9d-bbf2-5a77df283ed1 req-24d7ba48-98f5-4a6b-a03e-172567d2e7b3 service nova] [instance: 20291d64-e5d7-47f5-8b9c-4e57dd4de314] Received event network-vif-deleted-420593ec-52b2-4b39-bcf8-c657c2448019 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:26 user nova-compute[74739]: INFO nova.compute.manager [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Detaching volume 7b8c184a-0ee3-4699-9054-b28e0234356e
Oct 25 18:04:26 user nova-compute[74739]: INFO nova.virt.block_device [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Attempting to driver detach volume 7b8c184a-0ee3-4699-9054-b28e0234356e from mountpoint /dev/vdb
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Attempting to detach device vdb from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:04:26 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:04:26 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:04:26 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:04:26 user nova-compute[74739]:   <serial>7b8c184a-0ee3-4699-9054-b28e0234356e</serial>
Oct 25 18:04:26 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:04:26 user nova-compute[74739]: </disk>
Oct 25 18:04:26 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:04:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully detached device vdb from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the persistent domain config.
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:04:26 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:04:26 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:04:26 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:04:26 user nova-compute[74739]:   <serial>7b8c184a-0ee3-4699-9054-b28e0234356e</serial>
Oct 25 18:04:26 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:04:26 user nova-compute[74739]: </disk>
Oct 25 18:04:26 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:04:27 user nova-compute[74739]: INFO nova.compute.claims [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Claim successful on node user
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:04:27 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.policy [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6db74d902fa431fa5d589ecba46f62e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e66ef0c6013c4135859334630a6cef2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:04:27 user nova-compute[74739]: INFO nova.virt.block_device [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Booting with volume 7edb1d67-fea4-4102-92cb-7831f1137db2 at /dev/vda
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.utils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220c6bf-e947-43f1-a921-23e213d04c3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[809621bc-39c0-40ef-9e8d-c5af0783d676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e98365-43a7-4ea3-ad84-b7cd41fa1e8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347d472-0ffb-41c9-b5b8-965ea9fcb280]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:04:27 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:04:27 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fd05f1-ec16-4844-8430-207db8ce68cf]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG os_brick.utils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:04:27 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating existing volume attachment record: 07676326-969b-48c8-a06b-4fb12c49d192 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:04:28 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Successfully created port: 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Successfully updated port: 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing instance network info cache due to event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance network_info: |[{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated VIF entry in instance network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG nova.network.neutron [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5977d7a3-cfaa-4e62-a70d-7fb8f08ce536 req-b2aa2674-1671-4e44-95e8-bdc4bb91a473 service nova] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:04:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:31 user nova-compute[74739]: INFO nova.compute.manager [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Terminating instance
Oct 25 18:04:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-43ac5be4-f2e7-45c4-b960-61a934846fa0 req-d849855e-c532-453e-8b7e-eb5f45892c60 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Instance destroyed successfully.
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid eff7760a-3bdd-4322-bb7d-8bd9ad669a14 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-207586830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-207586830',id=27,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-jxg9a0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:02:46Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=eff7760a-3bdd-4322-bb7d-8bd9ad669a14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "457f798c-592f-43b3-b337-5ff9e88f23c9", "address": "fa:16:3e:ed:29:95", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap457f798c-59", "ovs_interfaceid": "457f798c-592f-43b3-b337-5ff9e88f23c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_vif [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap457f798c-59, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccbdf74d-8cd1-494d-91a7-a92011439ec3) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:32 user nova-compute[74739]: INFO os_vif [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:29:95,bridge_name='br-int',has_traffic_filtering=True,id=457f798c-592f-43b3-b337-5ff9e88f23c9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap457f798c-59')
Oct 25 18:04:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKQUTbmO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:04:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96d6ff-39af-44c8-84f5-1ca3e9e0f0fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:04:32 user nova-compute[74739]: No targets found.
Oct 25 18:04:32 user nova-compute[74739]: iSNS:
Oct 25 18:04:32 user nova-compute[74739]: No targets found.
Oct 25 18:04:32 user nova-compute[74739]: STATIC:
Oct 25 18:04:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511
Oct 25 18:04:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:04:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:04:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e
Oct 25 18:04:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:04:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:04:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:04:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:04:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:04:32 user nova-compute[74739]: FIRMWARE:
Oct 25 18:04:32 user nova-compute[74739]: No targets found.
Oct 25 18:04:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:04:32 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:04:32 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6867709-4701-4e40-b346-21800f348251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b95e950-7caf-412c-8062-1fb6506fe51f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:04:32 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:04:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 (non-flash)
Oct 25 18:04:32 user nova-compute[74739]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:04:32 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc3655a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d736cf2-d163-4d42-ae43-57ee50f8c491]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09391c04-c2ca-4420-8981-afc328c3fad6]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fede47-ad23-4e2e-983c-17c98c9b0e70]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c68518-e3cc-4a33-bd59-5c288a5e50e0]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f05b2007', '/dev/disk/by-id/scsi-1SCST_BIOf05b2007-1ffa97a2c53f06cc', '/dev/disk/by-id/scsi-23166666139376132') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca8b49-5607-4dd6-9e0c-e415092411ff]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:04:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f18ca-7f4b-4bb7-a7a7-8ba351ff71c7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8be25d-8426-4a2b-8d5a-169ae2402e23]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260]
Oct 25 18:04:33 user nova-compute[74739]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511, portal: 172.16.0.220,3260] successful.
Oct 25 18:04:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d9364d8-b977-44ef-9823-a50224b6e511 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93d778-8e12-49f4-9fc1-84e61b2d6506]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== disconnect_volume: return (411ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:04:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Deleting instance files /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14_del
Oct 25 18:04:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Deletion of /opt/stack/data/nova/instances/eff7760a-3bdd-4322-bb7d-8bd9ad669a14_del complete
Oct 25 18:04:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:33 user nova-compute[74739]: INFO nova.compute.manager [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Took 1.42 seconds to destroy the instance on the hypervisor.
Oct 25 18:04:33 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:04:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:04:33 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Took 0.55 seconds to deallocate network for instance.
Oct 25 18:04:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c2a9a2d0-74e4-4c43-8734-31917dfd031f req-3ea6bdd0-928a-485f-946f-e7abb81ba526 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-deleted-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:34 user nova-compute[74739]: WARNING nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state deleting.
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:34 user nova-compute[74739]: WARNING nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state deleting.
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:34 user nova-compute[74739]: WARNING nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state deleting.
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-unplugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Acquiring lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] No waiting events found dispatching network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:34 user nova-compute[74739]: WARNING nova.compute.manager [req-916ae838-4cd9-4436-8cba-f8f42eb92b94 req-d5cdbff0-5445-4e40-9f96-5edab37f02c7 service nova] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Received unexpected event network-vif-plugged-457f798c-592f-43b3-b337-5ff9e88f23c9 for instance with vm_state active and task_state deleting.
Oct 25 18:04:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:46 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c215818-8652-4adf-8aac-c45847b66df3 is timed out.
Oct 25 18:04:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully detached device vdb from instance 0c215818-8652-4adf-8aac-c45847b66df3 from the live domain config.
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kmXrhxdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:04:46 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3673ac-6b34-43d0-97c9-c8ef5889907e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:04:46 user nova-compute[74739]: No targets found.
Oct 25 18:04:46 user nova-compute[74739]: iSNS:
Oct 25 18:04:46 user nova-compute[74739]: No targets found.
Oct 25 18:04:46 user nova-compute[74739]: STATIC:
Oct 25 18:04:46 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e
Oct 25 18:04:46 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:04:46 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:04:46 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:04:46 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:04:46 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:04:46 user nova-compute[74739]: FIRMWARE:
Oct 25 18:04:46 user nova-compute[74739]: No targets found.
Oct 25 18:04:46 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:04:46 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:04:46 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b313f29-7975-4500-bfd9-16e2a0d4e7bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d60e6-b421-4b26-84b7-d311367686d8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:04:46 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:46 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e (non-flash)
Oct 25 18:04:46 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:46 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec5b04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b5ae5-7ca8-4e17-b1f5-4e04419dcf3c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e543cd-8cd0-4e84-b435-b947009717f7]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:04:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Creating image(s)
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Ensure instance console log exists: /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start _get_guest_xml network_info=[{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '07676326-969b-48c8-a06b-4fb12c49d192', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70725b4e-ae2c-4bc9-895c-31cb52123810', 'attached_at': '', 'detached_at': '', 'volume_id': '7edb1d67-fea4-4102-92cb-7831f1137db2', 'serial': '7edb1d67-fea4-4102-92cb-7831f1137db2'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e84c278-20d5-47fd-b76d-389297ff2aae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:04:46 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:46 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:04:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:04:46 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:04:47 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0a4f81-3a97-4bd6-bbd5-62b4b0b022f1]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[36575937-5ade-4f16-aa87-b8b136eb87fb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3484bf-0ed1-4645-bbc4-f30780c9ad02]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260]
Oct 25 18:04:47 user nova-compute[74739]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e, portal: 172.16.0.220,3260] successful.
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7b8c184a-0ee3-4699-9054-b28e0234356e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fac85a-869c-495e-8039-4c8a310180a0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] <== disconnect_volume: return (384ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.159s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:04:47 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:04:47 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc05106-c90f-463b-930f-da4612dd44c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:04:47 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a05c10f-34b0-4fb0-9871-d3a027c1aa51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2] added
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dfeb27-376a-4c73-bf1d-6b2136c4f3d7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7769e-1c91-43a4-8c49-3b7c00fe8cac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxDjkIwe {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxDjkIwe" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[096dd676-82e8-4019-9d91-afb6e893195c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gxDjkIwe'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[edca2e4b-1022-4615-abc1-2e69b2933f8c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8096fa8-44de-4b7f-83e0-fb3e9c7930d4]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9495b1-301e-421e-9731-1e959e0aac02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]
Oct 25 18:04:47 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac6635e-a8d1-40ad-8dab-3bc85ce6f134]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e1eff3-8c8e-443b-a1b4-6200fd1c8c66]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:04:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba90376-6968-4425-bd56-edfe36f115dd]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:04:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'flavor' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-43ff9e69-b674-4df6-8ee2-4d65afe6bbdf tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '26464663665303266', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464663665303266', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjFjXlR1IolTdEOI29YqXzKgi2yoqhj+6JA/H/pn4xbyNlZfvY+PQ/+Qax+U36H/w7wYzWPvvOLjGoOKtXk3aL3AiIUOrAbC7hisSXQGImhKJRKQ/YXCSCPHQizMzS9Xw==',key_name='tempest-TestShelveInstance-1529691634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:04:28Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'pci_devices' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:04:48 user nova-compute[74739]:   <uuid>70725b4e-ae2c-4bc9-895c-31cb52123810</uuid>
Oct 25 18:04:48 user nova-compute[74739]:   <name>instance-0000001e</name>
Oct 25 18:04:48 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:04:48 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:04:48 user nova-compute[74739]:   <metadata>
Oct 25 18:04:48 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:04:48 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:04:48 user nova-compute[74739]:       <nova:name>tempest-TestShelveInstance-server-279757795</nova:name>
Oct 25 18:04:48 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:04:46</nova:creationTime>
Oct 25 18:04:48 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:04:48 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:04:48 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:04:48 user nova-compute[74739]:       <nova:owner>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:user uuid="d6db74d902fa431fa5d589ecba46f62e">tempest-TestShelveInstance-692370709-project-member</nova:user>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:project uuid="e66ef0c6013c4135859334630a6cef2a">tempest-TestShelveInstance-692370709</nova:project>
Oct 25 18:04:48 user nova-compute[74739]:       </nova:owner>
Oct 25 18:04:48 user nova-compute[74739]:       <nova:ports>
Oct 25 18:04:48 user nova-compute[74739]:         <nova:port uuid="1c4846a2-9a16-42fb-9f57-11f6d1d0f73a">
Oct 25 18:04:48 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 18:04:48 user nova-compute[74739]:         </nova:port>
Oct 25 18:04:48 user nova-compute[74739]:       </nova:ports>
Oct 25 18:04:48 user nova-compute[74739]:     </nova:instance>
Oct 25 18:04:48 user nova-compute[74739]:   </metadata>
Oct 25 18:04:48 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:04:48 user nova-compute[74739]:     <system>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="serial">70725b4e-ae2c-4bc9-895c-31cb52123810</entry>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="uuid">70725b4e-ae2c-4bc9-895c-31cb52123810</entry>
Oct 25 18:04:48 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:04:48 user nova-compute[74739]:     </system>
Oct 25 18:04:48 user nova-compute[74739]:   </sysinfo>
Oct 25 18:04:48 user nova-compute[74739]:   <os>
Oct 25 18:04:48 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:04:48 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:04:48 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:04:48 user nova-compute[74739]:   </os>
Oct 25 18:04:48 user nova-compute[74739]:   <features>
Oct 25 18:04:48 user nova-compute[74739]:     <acpi/>
Oct 25 18:04:48 user nova-compute[74739]:     <apic/>
Oct 25 18:04:48 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:04:48 user nova-compute[74739]:   </features>
Oct 25 18:04:48 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:04:48 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:04:48 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:04:48 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:04:48 user nova-compute[74739]:   </clock>
Oct 25 18:04:48 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:04:48 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:04:48 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:04:48 user nova-compute[74739]:   </cpu>
Oct 25 18:04:48 user nova-compute[74739]:   <devices>
Oct 25 18:04:48 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:04:48 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:04:48 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 18:04:48 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:04:48 user nova-compute[74739]:       <serial>7edb1d67-fea4-4102-92cb-7831f1137db2</serial>
Oct 25 18:04:48 user nova-compute[74739]:     </disk>
Oct 25 18:04:48 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:04:48 user nova-compute[74739]:       <mac address="fa:16:3e:7c:4c:5f"/>
Oct 25 18:04:48 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:04:48 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:04:48 user nova-compute[74739]:       <target dev="tap1c4846a2-9a"/>
Oct 25 18:04:48 user nova-compute[74739]:     </interface>
Oct 25 18:04:48 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:04:48 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810/console.log" append="off"/>
Oct 25 18:04:48 user nova-compute[74739]:     </serial>
Oct 25 18:04:48 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:04:48 user nova-compute[74739]:     <video>
Oct 25 18:04:48 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:04:48 user nova-compute[74739]:     </video>
Oct 25 18:04:48 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:04:48 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:04:48 user nova-compute[74739]:     </rng>
Oct 25 18:04:48 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:04:48 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:04:48 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:04:48 user nova-compute[74739]:     </memballoon>
Oct 25 18:04:48 user nova-compute[74739]:   </devices>
Oct 25 18:04:48 user nova-compute[74739]: </domain>
Oct 25 18:04:48 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjFjXlR1IolTdEOI29YqXzKgi2yoqhj+6JA/H/pn4xbyNlZfvY+PQ/+Qax+U36H/w7wYzWPvvOLjGoOKtXk3aL3AiIUOrAbC7hisSXQGImhKJRKQ/YXCSCPHQizMzS9Xw==',key_name='tempest-TestShelveInstance-1529691634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:04:28Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG os_vif [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c40faa09-86fc-5f1e-9207-d215f58a5414', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c4846a2-9a, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c4846a2-9a, col_values=(('qos', UUID('96ebc4be-2af6-4244-aead-2b2fdb02d065')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c4846a2-9a, col_values=(('external_ids', {'iface-id': '1c4846a2-9a16-42fb-9f57-11f6d1d0f73a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:4c:5f', 'vm-uuid': '70725b4e-ae2c-4bc9-895c-31cb52123810'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:48 user nova-compute[74739]: INFO os_vif [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a')
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:04:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] No VIF found with MAC fa:16:3e:7c:4c:5f, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:50 user nova-compute[74739]: WARNING nova.compute.manager [req-5dcb4240-b7d5-45fe-a349-26474fcb83cf req-7707fc59-6df2-4752-aa6a-df5771b45fbd service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state building and task_state spawning.
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: INFO nova.compute.manager [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: eff7760a-3bdd-4322-bb7d-8bd9ad669a14] Took 16.96 seconds to detach 1 volumes for instance.
Oct 25 18:04:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:51 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:04:51 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:04:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:51 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Deleted allocations for instance eff7760a-3bdd-4322-bb7d-8bd9ad669a14
Oct 25 18:04:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-fa109e71-02e2-4eff-915c-e08efc92d878 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "eff7760a-3bdd-4322-bb7d-8bd9ad669a14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 19.475s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:04:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance spawned successfully.
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:04:52 user nova-compute[74739]: INFO nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:04:52 user nova-compute[74739]: WARNING nova.compute.manager [req-3154c4bb-739e-4dfa-8158-8ed6cb8bc975 req-3dcb2f7c-d003-4b04-a4f3-b569195d75c0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state building and task_state spawning.
Oct 25 18:04:52 user nova-compute[74739]: INFO nova.compute.manager [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Took 25.40 seconds to build instance.
Oct 25 18:04:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e518404a-1d14-4a4a-897e-c3a2f5f085e8 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.529s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:04:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:04:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:05:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:05:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:16 user nova-compute[74739]: INFO nova.compute.manager [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Terminating instance
Oct 25 18:05:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [{"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c463c6be-cd71-4bd9-9b83-7485d5ff9afd" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-unplugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] No waiting events found dispatching network-vif-unplugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-75b4ee34-d428-4c54-b4e3-65f514b84537 req-a505467c-cea6-4609-bd71-d754c3297307 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-unplugged-a702b846-770e-4580-ad3c-51987a59b35b for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:05:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Instance destroyed successfully.
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.objects.instance [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lazy-loading 'resources' on Instance uuid 0c215818-8652-4adf-8aac-c45847b66df3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:00:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1046136457',display_name='tempest-TestServerVolumeAttachmentScenario-server-1046136457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1046136457',id=29,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ9Z/88zEYKF7y9OJYCmDQycEUIk117Ub58z+1DKYgXGIY8K+Z01nnW4sNzEivhsbB+E8Zz18icIcZnstnsDfhgyxjcT6VwfLgxjFeBT5ThIfRi1mTZEmWtvO7lOgE5GA==',key_name='tempest-keypair-304347904',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a9251de527bf478ca04612fad735dbf8',ramdisk_id='',reservation_id='r-c452d6e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-715823229',owner_user_name='tempest-TestServerVolumeAttachmentScenario-715823229-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2c66017a2b34284bb238dc9b247d170',uuid=0c215818-8652-4adf-8aac-c45847b66df3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converting VIF {"id": "a702b846-770e-4580-ad3c-51987a59b35b", "address": "fa:16:3e:d0:50:8b", "network": {"id": "8c49a911-f2e4-4ddc-bca5-2672b78c014a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-862266727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a9251de527bf478ca04612fad735dbf8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa702b846-77", "ovs_interfaceid": "a702b846-770e-4580-ad3c-51987a59b35b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG os_vif [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa702b846-77, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aecf5782-ea80-461f-ab95-df5eccf6d281) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:17 user nova-compute[74739]: INFO os_vif [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:50:8b,bridge_name='br-int',has_traffic_filtering=True,id=a702b846-770e-4580-ad3c-51987a59b35b,network=Network(8c49a911-f2e4-4ddc-bca5-2672b78c014a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa702b846-77')
Oct 25 18:05:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Deleting instance files /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3_del
Oct 25 18:05:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Deletion of /opt/stack/data/nova/instances/0c215818-8652-4adf-8aac-c45847b66df3_del complete
Oct 25 18:05:17 user nova-compute[74739]: INFO nova.compute.manager [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 25 18:05:17 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:05:17 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:18 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Took 0.85 seconds to deallocate network for instance.
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e7581a1-0a5d-43ad-8a13-dc8fa228378d req-bdf669d2-1d93-4010-a44c-d5f69dca9c95 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-deleted-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:18 user nova-compute[74739]: INFO nova.compute.manager [req-9e7581a1-0a5d-43ad-8a13-dc8fa228378d req-bdf669d2-1d93-4010-a44c-d5f69dca9c95 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Neutron deleted interface a702b846-770e-4580-ad3c-51987a59b35b; detaching it from the instance and deleting it from the info cache
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.network.neutron [req-9e7581a1-0a5d-43ad-8a13-dc8fa228378d req-bdf669d2-1d93-4010-a44c-d5f69dca9c95 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.compute.manager [req-9e7581a1-0a5d-43ad-8a13-dc8fa228378d req-bdf669d2-1d93-4010-a44c-d5f69dca9c95 service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Detach interface failed, port_id=a702b846-770e-4580-ad3c-51987a59b35b, reason: Instance 0c215818-8652-4adf-8aac-c45847b66df3 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.028s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:18 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:05:18 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Deleted allocations for instance 0c215818-8652-4adf-8aac-c45847b66df3
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-04ea9938-0f69-40ef-8cff-3cee2442e8d7 tempest-TestServerVolumeAttachmentScenario-715823229 tempest-TestServerVolumeAttachmentScenario-715823229-project-member] Lock "0c215818-8652-4adf-8aac-c45847b66df3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.454s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] Acquiring lock "0c215818-8652-4adf-8aac-c45847b66df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] Lock "0c215818-8652-4adf-8aac-c45847b66df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] No waiting events found dispatching network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:19 user nova-compute[74739]: WARNING nova.compute.manager [req-c034b630-3a46-4bb3-99f7-87c2f99ca177 req-2db8f2db-76cc-404e-98e8-43f98441b89d service nova] [instance: 0c215818-8652-4adf-8aac-c45847b66df3] Received unexpected event network-vif-plugged-a702b846-770e-4580-ad3c-51987a59b35b for instance with vm_state deleted and task_state None.
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:05:20 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8265MB free_disk=24.913284301757812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3ebb8df7-813e-4118-9689-f56934edf958 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance f9569bc3-c6d4-4eb1-9a6f-73549952097f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 90654bc3-128a-4c50-a106-e919cc201796 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 70725b4e-ae2c-4bc9-895c-31cb52123810 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:05:20 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:05:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:05:21 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:05:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:05:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:22 user nova-compute[74739]: INFO nova.compute.manager [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Terminating instance
Oct 25 18:05:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-unplugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] No waiting events found dispatching network-vif-unplugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c2f35e48-d9d0-41d9-9485-4e5c57bb2924 req-74216ce8-e032-4990-a2a0-d03f6f3b17f5 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-unplugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Instance destroyed successfully.
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid 90654bc3-128a-4c50-a106-e919cc201796 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1513987037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1513987037',id=22,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-rjqmlw7i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:57:56Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=90654bc3-128a-4c50-a106-e919cc201796,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "address": "fa:16:3e:61:6a:11", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca62fe2b-75", "ovs_interfaceid": "ca62fe2b-759a-4f35-bf61-fca1a4c586f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG os_vif [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca62fe2b-75, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a8d24d91-3342-4602-b0c4-d51fd8558bd3) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:23 user nova-compute[74739]: INFO os_vif [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:6a:11,bridge_name='br-int',has_traffic_filtering=True,id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca62fe2b-75')
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Deleting instance files /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796_del
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Deletion of /opt/stack/data/nova/instances/90654bc3-128a-4c50-a106-e919cc201796_del complete
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.compute.manager [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 25 18:05:23 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Took 0.50 seconds to deallocate network for instance.
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-ffee0a0e-246d-44cc-b0e2-4df89b4b2d19 req-0ae84fb2-22f9-4395-88a4-3a5d1238e9c9 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-deleted-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:23 user nova-compute[74739]: INFO nova.compute.manager [req-ffee0a0e-246d-44cc-b0e2-4df89b4b2d19 req-0ae84fb2-22f9-4395-88a4-3a5d1238e9c9 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Neutron deleted interface ca62fe2b-759a-4f35-bf61-fca1a4c586f9; detaching it from the instance and deleting it from the info cache
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-ffee0a0e-246d-44cc-b0e2-4df89b4b2d19 req-0ae84fb2-22f9-4395-88a4-3a5d1238e9c9 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-ffee0a0e-246d-44cc-b0e2-4df89b4b2d19 req-0ae84fb2-22f9-4395-88a4-3a5d1238e9c9 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Detach interface failed, port_id=ca62fe2b-759a-4f35-bf61-fca1a4c586f9, reason: Instance 90654bc3-128a-4c50-a106-e919cc201796 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:05:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:24 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Deleted allocations for instance 90654bc3-128a-4c50-a106-e919cc201796
Oct 25 18:05:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-206c9e14-4417-410f-9536-1d085930ca6d tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "90654bc3-128a-4c50-a106-e919cc201796" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] Acquiring lock "90654bc3-128a-4c50-a106-e919cc201796-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] Lock "90654bc3-128a-4c50-a106-e919cc201796-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] No waiting events found dispatching network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:25 user nova-compute[74739]: WARNING nova.compute.manager [req-d269b4d0-d2c6-45ec-96e5-21a02ec6603b req-e63a73e6-f34b-4b24-9434-205c8639d185 service nova] [instance: 90654bc3-128a-4c50-a106-e919cc201796] Received unexpected event network-vif-plugged-ca62fe2b-759a-4f35-bf61-fca1a4c586f9 for instance with vm_state deleted and task_state None.
Oct 25 18:05:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:05:45 user nova-compute[74739]: INFO nova.compute.claims [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Claim successful on node user
Oct 25 18:05:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:05:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.policy [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0a42eef8b354d4fad0b4eb277270cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2286f0b19a436897ed0d9c42991e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:05:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Creating image(s)
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk 1073741824" returned: 0 in 0.053s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Successfully created port: bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Cannot resize image /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Ensure instance console log exists: /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Successfully updated port: bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing instance network info cache due to event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:05:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Instance network_info: |[{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Start _get_guest_xml network_info=[{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:05:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:05:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-113405100',display_name='tempest-ServerActionsTestOtherA-server-113405100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-113405100',id=31,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-0fpooj7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=c5e5321b-04b9-40b9-8038-9f85cf4daf7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'pci_devices' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:05:48 user nova-compute[74739]:   <uuid>c5e5321b-04b9-40b9-8038-9f85cf4daf7e</uuid>
Oct 25 18:05:48 user nova-compute[74739]:   <name>instance-0000001f</name>
Oct 25 18:05:48 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:05:48 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:05:48 user nova-compute[74739]:   <metadata>
Oct 25 18:05:48 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:05:48 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherA-server-113405100</nova:name>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:05:48</nova:creationTime>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:05:48 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:05:48 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:owner>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:user uuid="b0a42eef8b354d4fad0b4eb277270cb4">tempest-ServerActionsTestOtherA-1860404749-project-member</nova:user>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:project uuid="ee2286f0b19a436897ed0d9c42991e06">tempest-ServerActionsTestOtherA-1860404749</nova:project>
Oct 25 18:05:48 user nova-compute[74739]:       </nova:owner>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:05:48 user nova-compute[74739]:       <nova:ports>
Oct 25 18:05:48 user nova-compute[74739]:         <nova:port uuid="bd5bf9d3-ef73-43ea-8402-52ff583d78c3">
Oct 25 18:05:48 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 18:05:48 user nova-compute[74739]:         </nova:port>
Oct 25 18:05:48 user nova-compute[74739]:       </nova:ports>
Oct 25 18:05:48 user nova-compute[74739]:     </nova:instance>
Oct 25 18:05:48 user nova-compute[74739]:   </metadata>
Oct 25 18:05:48 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:05:48 user nova-compute[74739]:     <system>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="serial">c5e5321b-04b9-40b9-8038-9f85cf4daf7e</entry>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="uuid">c5e5321b-04b9-40b9-8038-9f85cf4daf7e</entry>
Oct 25 18:05:48 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:05:48 user nova-compute[74739]:     </system>
Oct 25 18:05:48 user nova-compute[74739]:   </sysinfo>
Oct 25 18:05:48 user nova-compute[74739]:   <os>
Oct 25 18:05:48 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:05:48 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:05:48 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:05:48 user nova-compute[74739]:   </os>
Oct 25 18:05:48 user nova-compute[74739]:   <features>
Oct 25 18:05:48 user nova-compute[74739]:     <acpi/>
Oct 25 18:05:48 user nova-compute[74739]:     <apic/>
Oct 25 18:05:48 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:05:48 user nova-compute[74739]:   </features>
Oct 25 18:05:48 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:05:48 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:05:48 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:05:48 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:05:48 user nova-compute[74739]:   </clock>
Oct 25 18:05:48 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:05:48 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:05:48 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:05:48 user nova-compute[74739]:   </cpu>
Oct 25 18:05:48 user nova-compute[74739]:   <devices>
Oct 25 18:05:48 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:05:48 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:05:48 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk"/>
Oct 25 18:05:48 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:05:48 user nova-compute[74739]:     </disk>
Oct 25 18:05:48 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:05:48 user nova-compute[74739]:       <mac address="fa:16:3e:c3:ad:47"/>
Oct 25 18:05:48 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:05:48 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:05:48 user nova-compute[74739]:       <target dev="tapbd5bf9d3-ef"/>
Oct 25 18:05:48 user nova-compute[74739]:     </interface>
Oct 25 18:05:48 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:05:48 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/console.log" append="off"/>
Oct 25 18:05:48 user nova-compute[74739]:     </serial>
Oct 25 18:05:48 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:05:48 user nova-compute[74739]:     <video>
Oct 25 18:05:48 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:05:48 user nova-compute[74739]:     </video>
Oct 25 18:05:48 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:05:48 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:05:48 user nova-compute[74739]:     </rng>
Oct 25 18:05:48 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:05:48 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:05:48 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:05:48 user nova-compute[74739]:     </memballoon>
Oct 25 18:05:48 user nova-compute[74739]:   </devices>
Oct 25 18:05:48 user nova-compute[74739]: </domain>
Oct 25 18:05:48 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-113405100',display_name='tempest-ServerActionsTestOtherA-server-113405100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-113405100',id=31,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-0fpooj7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=c5e5321b-04b9-40b9-8038-9f85cf4daf7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG os_vif [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe71d44c-0ad6-5a34-b716-0569cc6bdfe3', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd5bf9d3-ef, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd5bf9d3-ef, col_values=(('qos', UUID('b77466c1-6ee5-4971-b746-5ed8609423fe')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd5bf9d3-ef, col_values=(('external_ids', {'iface-id': 'bd5bf9d3-ef73-43ea-8402-52ff583d78c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ad:47', 'vm-uuid': 'c5e5321b-04b9-40b9-8038-9f85cf4daf7e'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:48 user nova-compute[74739]: INFO os_vif [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef')
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:c3:ad:47, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated VIF entry in instance network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-44b82bad-9cea-4ce0-83ad-0c0b505e81ab req-6bcfebdb-9264-4786-b6e6-6f54e02345b8 service nova] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] No waiting events found dispatching network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:49 user nova-compute[74739]: WARNING nova.compute.manager [req-5e7c3b20-33c6-462b-a33d-14e6007a56ab req-a5ade391-c7d9-4ef0-94d1-d0c3739268d9 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received unexpected event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 for instance with vm_state building and task_state spawning.
Oct 25 18:05:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:05:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Instance spawned successfully.
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:05:51 user nova-compute[74739]: INFO nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 25 18:05:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:05:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] No waiting events found dispatching network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:52 user nova-compute[74739]: WARNING nova.compute.manager [req-c7f870d2-a7e7-4854-b208-a08d1eb2446b req-13bc7286-fe0f-41e6-a8be-7bbc16f19235 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received unexpected event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 for instance with vm_state building and task_state spawning.
Oct 25 18:05:52 user nova-compute[74739]: INFO nova.compute.manager [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Took 6.85 seconds to build instance.
Oct 25 18:05:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a09abef3-86fe-4afa-9143-734ed8c9b0b9 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.953s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:56 user nova-compute[74739]: INFO nova.compute.manager [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Terminating instance
Oct 25 18:05:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-b42833ab-0a34-4b24-9ffc-754054ad93c3 req-eb119bcf-49a4-41c2-a3b3-d49a70ff0e74 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-unplugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:05:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Instance destroyed successfully.
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'resources' on Instance uuid f9569bc3-c6d4-4eb1-9a6f-73549952097f {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:55:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1114405803',display_name='tempest-AttachVolumeTestJSON-server-1114405803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1114405803',id=21,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDlAA9stKZrXsVmQMN+ne27Nd6rUbwTvWEKQYB1NVjQDNNxDdjalH0u4rWtwEDszWG4sshGvJyxjMMzn/fT0ihDGpUoDkG7qtN8hZ9VZ2vR6+1r1srBqfMm4EibXHiHQw==',key_name='tempest-keypair-182659494',keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:55:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-7hmddvnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=f9569bc3-c6d4-4eb1-9a6f-73549952097f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "b50c4378-46f7-449b-8c0b-1c4082488139", "address": "fa:16:3e:15:58:53", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb50c4378-46", "ovs_interfaceid": "b50c4378-46f7-449b-8c0b-1c4082488139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG os_vif [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb50c4378-46, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3eef927d-7312-4c47-8520-198af6b99ab2) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:05:57 user nova-compute[74739]: INFO os_vif [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:58:53,bridge_name='br-int',has_traffic_filtering=True,id=b50c4378-46f7-449b-8c0b-1c4082488139,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb50c4378-46')
Oct 25 18:05:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Deleting instance files /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f_del
Oct 25 18:05:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Deletion of /opt/stack/data/nova/instances/f9569bc3-c6d4-4eb1-9a6f-73549952097f_del complete
Oct 25 18:05:57 user nova-compute[74739]: INFO nova.compute.manager [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 25 18:05:57 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:05:57 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:05:58 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:05:58 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Took 0.78 seconds to deallocate network for instance.
Oct 25 18:05:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:58 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:05:58 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:05:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:58 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Deleted allocations for instance f9569bc3-c6d4-4eb1-9a6f-73549952097f
Oct 25 18:05:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bedfab11-79c4-491f-a509-44017c1ebada tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:05:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] Acquiring lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:05:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:05:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] Lock "f9569bc3-c6d4-4eb1-9a6f-73549952097f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:05:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] No waiting events found dispatching network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:05:59 user nova-compute[74739]: WARNING nova.compute.manager [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received unexpected event network-vif-plugged-b50c4378-46f7-449b-8c0b-1c4082488139 for instance with vm_state deleted and task_state None.
Oct 25 18:05:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-40fc78a1-6aea-4e42-93db-038cd464ded1 req-a97c2b14-2781-4312-8526-98e11d4f2884 service nova] [instance: f9569bc3-c6d4-4eb1-9a6f-73549952097f] Received event network-vif-deleted-b50c4378-46f7-449b-8c0b-1c4082488139 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:13 user nova-compute[74739]: INFO nova.compute.manager [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Terminating instance
Oct 25 18:06:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-14ed974e-1578-46f4-aff1-54462969d471 req-a95c2238-f998-4215-a44c-36cb11d018fc service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-unplugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:06:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Instance destroyed successfully.
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid 3ebb8df7-813e-4118-9689-f56934edf958 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1931905537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1931905537',id=13,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-fo89rnny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:54:12Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=3ebb8df7-813e-4118-9689-f56934edf958,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "address": "fa:16:3e:44:d9:50", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eacc6fc-2f", "ovs_interfaceid": "9eacc6fc-2f3b-4670-93ec-9e7f49969255", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_vif [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eacc6fc-2f, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1ecdc4c-19c8-4599-b8f4-b3d4c4b5ca74) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:14 user nova-compute[74739]: INFO os_vif [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:d9:50,bridge_name='br-int',has_traffic_filtering=True,id=9eacc6fc-2f3b-4670-93ec-9e7f49969255,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eacc6fc-2f')
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'srJwcgim', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:06:14 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.099s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69feccb-90c5-430d-9314-8fd65c228d58]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:06:14 user nova-compute[74739]: No targets found.
Oct 25 18:06:14 user nova-compute[74739]: iSNS:
Oct 25 18:06:14 user nova-compute[74739]: No targets found.
Oct 25 18:06:14 user nova-compute[74739]: STATIC:
Oct 25 18:06:14 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2
Oct 25 18:06:14 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:06:14 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:06:14 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118
Oct 25 18:06:14 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:06:14 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:06:14 user nova-compute[74739]: FIRMWARE:
Oct 25 18:06:14 user nova-compute[74739]: No targets found.
Oct 25 18:06:14 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:06:14 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:06:14 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f1780-5472-4d58-94ac-c87cbf7c1c87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75192c-900c-42d8-bd90-72daac501940]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:06:14 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:06:14 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:06:14 user nova-compute[74739]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 (non-flash)
Oct 25 18:06:14 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec176dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335c29d-07e5-4e95-aab4-bfd398c0c410]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e98baec-5833-416d-92a8-4ca3d7e88748]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[088502e4-5ec8-4231-9cf6-9d997e2c085b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b63d61-67e1-4c41-9187-ed8f7fd30ad4]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2863f130-3b3d-41cd-aef3-5a082dd28380]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b435c0ad-c3be-43ac-9677-7f59acfb5e61]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260]
Oct 25 18:06:14 user nova-compute[74739]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118, portal: 172.16.0.220,3260] successful.
Oct 25 18:06:14 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72ee0394-046b-4829-8988-a682bfacb118 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c996436-2ad4-4469-8183-ce8619115699]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] <== disconnect_volume: return (441ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:06:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Deleting instance files /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958_del
Oct 25 18:06:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Deletion of /opt/stack/data/nova/instances/3ebb8df7-813e-4118-9689-f56934edf958_del complete
Oct 25 18:06:14 user nova-compute[74739]: INFO nova.compute.manager [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 25 18:06:14 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:06:14 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:15 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Took 0.51 seconds to deallocate network for instance.
Oct 25 18:06:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] Acquiring lock "3ebb8df7-813e-4118-9689-f56934edf958-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] Lock "3ebb8df7-813e-4118-9689-f56934edf958-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] No waiting events found dispatching network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:15 user nova-compute[74739]: WARNING nova.compute.manager [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received unexpected event network-vif-plugged-9eacc6fc-2f3b-4670-93ec-9e7f49969255 for instance with vm_state active and task_state deleting.
Oct 25 18:06:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-0cbbeb1e-6f22-4a24-b3cf-cce185e21953 req-ca7b9b3f-6890-48b7-80c2-fafd6897c9be service nova] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Received event network-vif-deleted-9eacc6fc-2f3b-4670-93ec-9e7f49969255 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:16 user nova-compute[74739]: INFO nova.compute.manager [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: 3ebb8df7-813e-4118-9689-f56934edf958] Took 0.95 seconds to detach 1 volumes for instance.
Oct 25 18:06:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:16 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Deleted allocations for instance 3ebb8df7-813e-4118-9689-f56934edf958
Oct 25 18:06:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-56874fde-fc49-494b-9153-b09074d77305 tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "3ebb8df7-813e-4118-9689-f56934edf958" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:06:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing instance network info cache due to event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated VIF entry in instance network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:06:19 user nova-compute[74739]: DEBUG nova.network.neutron [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4c334977-541c-4401-b962-fe784007a1fa req-b51e8b77-2363-4ac1-8d4c-237a65d5a599 service nova] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:20 user nova-compute[74739]: INFO nova.compute.manager [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Shelve offloading
Oct 25 18:06:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG nova.compute.manager [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:20 user nova-compute[74739]: WARNING nova.compute.manager [req-0753e05a-73fd-4066-ba1a-19348ac99df9 req-f6c138fd-56fd-4506-b255-530ed5b32eb0 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state active and task_state shelving.
Oct 25 18:06:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:20 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance destroyed successfully.
Oct 25 18:06:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:06:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8438MB free_disk=25.025684356689453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 70725b4e-ae2c-4bc9-895c-31cb52123810 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:06:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance destroyed successfully.
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'resources' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjFjXlR1IolTdEOI29YqXzKgi2yoqhj+6JA/H/pn4xbyNlZfvY+PQ/+Qax+U36H/w7wYzWPvvOLjGoOKtXk3aL3AiIUOrAbC7hisSXQGImhKJRKQ/YXCSCPHQizMzS9Xw==',key_name='tempest-TestShelveInstance-1529691634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:04:52Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_vif [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c4846a2-9a, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96ebc4be-2af6-4244-aead-2b2fdb02d065) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:22 user nova-compute[74739]: INFO os_vif [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a')
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:06:22 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0a09b7-3727-4554-9a0b-da26cdf21837]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:06:22 user nova-compute[74739]: No targets found.
Oct 25 18:06:22 user nova-compute[74739]: iSNS:
Oct 25 18:06:22 user nova-compute[74739]: No targets found.
Oct 25 18:06:22 user nova-compute[74739]: STATIC:
Oct 25 18:06:22 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2
Oct 25 18:06:22 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:06:22 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:06:22 user nova-compute[74739]: FIRMWARE:
Oct 25 18:06:22 user nova-compute[74739]: No targets found.
Oct 25 18:06:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:06:22 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:06:22 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8ec70-3c7b-4051-b330-6e305f0ed126]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369da2d-9bb0-4b33-a073-00d510a68424]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:06:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:06:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc23c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:22 user nova-compute[74739]: WARNING nova.compute.manager [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state active and task_state shelving.
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing instance network info cache due to event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3615c6d1-26c2-4efa-a93e-8e0fe095e197]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[182ec509-06ce-4ace-ad3c-478c0025d752]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7cdd83-ff7a-4b65-9a94-08ffb7d88b0d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee867157-4369-4255-86e5-7624cfce1187]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b561f2c-fb1f-4399-8226-bc8f1dbc370e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ff163e-0bee-4c64-aada-9e9f0c26a6e0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]
Oct 25 18:06:22 user nova-compute[74739]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.
Oct 25 18:06:22 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12cec75-6ce0-499f-8b44-ab52ab16bdaf]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== disconnect_volume: return (325ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:06:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:06:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deleting instance files /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810_del
Oct 25 18:06:22 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deletion of /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810_del complete
Oct 25 18:06:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated VIF entry in instance network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:06:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": null, "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9019676-a97a-4842-a198-aea5c1249ea7 req-3195a700-cf07-4d84-b757-2f6e43e11fce service nova] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:23 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Deleted allocations for instance 70725b4e-ae2c-4bc9-895c-31cb52123810
Oct 25 18:06:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'numa_topology' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG nova.objects.base [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Object Instance<70725b4e-ae2c-4bc9-895c-31cb52123810> lazy-loaded attributes: resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d4ff9db7-64ec-4552-803e-9a758f065807 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.145s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:06:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:06:51 user nova-compute[74739]: INFO nova.compute.claims [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Claim successful on node user
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:06:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:06:51 user nova-compute[74739]: DEBUG nova.policy [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73137a888d964149abda3bcac8293e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1631249d25ff403daae6c41e03fd040f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:06:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Creating image(s)
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "/opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "/opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk 1073741824" returned: 0 in 0.045s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Successfully created port: fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Cannot resize image /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Ensure instance console log exists: /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Successfully updated port: fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquired lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-changed-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Refreshing instance network info cache due to event network-changed-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] Acquiring lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Releasing lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Instance network_info: |[{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] Acquired lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.neutron [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Refreshing network info cache for port fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Start _get_guest_xml network_info=[{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:06:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:06:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1304208624',display_name='tempest-AttachVolumeTestJSON-server-1304208624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1304208624',id=32,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeLJUw9QO6/nLOpawbZiv0jpoUuk67MJzU7t9Rx1+2gF7uaD68l+4g37uV9+O5gIM7LjqyC0sfbJBvPD7fP75FV8UArwVg8Rrf+N5d96k/Br0mxlROLwsQvNvM3/281+Q==',key_name='tempest-keypair-1423565967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-drbij04a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=dc135ee2-5e7b-44ce-aaa4-5471a49edc7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'pci_devices' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:06:53 user nova-compute[74739]:   <uuid>dc135ee2-5e7b-44ce-aaa4-5471a49edc7d</uuid>
Oct 25 18:06:53 user nova-compute[74739]:   <name>instance-00000020</name>
Oct 25 18:06:53 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:06:53 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:06:53 user nova-compute[74739]:   <metadata>
Oct 25 18:06:53 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:06:53 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeTestJSON-server-1304208624</nova:name>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:06:53</nova:creationTime>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:06:53 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:06:53 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:owner>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:user uuid="73137a888d964149abda3bcac8293e01">tempest-AttachVolumeTestJSON-1878388259-project-member</nova:user>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:project uuid="1631249d25ff403daae6c41e03fd040f">tempest-AttachVolumeTestJSON-1878388259</nova:project>
Oct 25 18:06:53 user nova-compute[74739]:       </nova:owner>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:06:53 user nova-compute[74739]:       <nova:ports>
Oct 25 18:06:53 user nova-compute[74739]:         <nova:port uuid="fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1">
Oct 25 18:06:53 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 18:06:53 user nova-compute[74739]:         </nova:port>
Oct 25 18:06:53 user nova-compute[74739]:       </nova:ports>
Oct 25 18:06:53 user nova-compute[74739]:     </nova:instance>
Oct 25 18:06:53 user nova-compute[74739]:   </metadata>
Oct 25 18:06:53 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:06:53 user nova-compute[74739]:     <system>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="serial">dc135ee2-5e7b-44ce-aaa4-5471a49edc7d</entry>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="uuid">dc135ee2-5e7b-44ce-aaa4-5471a49edc7d</entry>
Oct 25 18:06:53 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:06:53 user nova-compute[74739]:     </system>
Oct 25 18:06:53 user nova-compute[74739]:   </sysinfo>
Oct 25 18:06:53 user nova-compute[74739]:   <os>
Oct 25 18:06:53 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:06:53 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:06:53 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:06:53 user nova-compute[74739]:   </os>
Oct 25 18:06:53 user nova-compute[74739]:   <features>
Oct 25 18:06:53 user nova-compute[74739]:     <acpi/>
Oct 25 18:06:53 user nova-compute[74739]:     <apic/>
Oct 25 18:06:53 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:06:53 user nova-compute[74739]:   </features>
Oct 25 18:06:53 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:06:53 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:06:53 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:06:53 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:06:53 user nova-compute[74739]:   </clock>
Oct 25 18:06:53 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:06:53 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:06:53 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:06:53 user nova-compute[74739]:   </cpu>
Oct 25 18:06:53 user nova-compute[74739]:   <devices>
Oct 25 18:06:53 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:06:53 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:06:53 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk"/>
Oct 25 18:06:53 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:06:53 user nova-compute[74739]:     </disk>
Oct 25 18:06:53 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:06:53 user nova-compute[74739]:       <mac address="fa:16:3e:f8:64:63"/>
Oct 25 18:06:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:06:53 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:06:53 user nova-compute[74739]:       <target dev="tapfe3ed6d3-4e"/>
Oct 25 18:06:53 user nova-compute[74739]:     </interface>
Oct 25 18:06:53 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:06:53 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/console.log" append="off"/>
Oct 25 18:06:53 user nova-compute[74739]:     </serial>
Oct 25 18:06:53 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:06:53 user nova-compute[74739]:     <video>
Oct 25 18:06:53 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:06:53 user nova-compute[74739]:     </video>
Oct 25 18:06:53 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:06:53 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:06:53 user nova-compute[74739]:     </rng>
Oct 25 18:06:53 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:06:53 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:06:53 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:06:53 user nova-compute[74739]:     </memballoon>
Oct 25 18:06:53 user nova-compute[74739]:   </devices>
Oct 25 18:06:53 user nova-compute[74739]: </domain>
Oct 25 18:06:53 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1304208624',display_name='tempest-AttachVolumeTestJSON-server-1304208624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1304208624',id=32,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeLJUw9QO6/nLOpawbZiv0jpoUuk67MJzU7t9Rx1+2gF7uaD68l+4g37uV9+O5gIM7LjqyC0sfbJBvPD7fP75FV8UArwVg8Rrf+N5d96k/Br0mxlROLwsQvNvM3/281+Q==',key_name='tempest-keypair-1423565967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-drbij04a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=dc135ee2-5e7b-44ce-aaa4-5471a49edc7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG os_vif [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05b40acb-c9e2-5340-b9d2-eac4cb526347', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe3ed6d3-4e, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe3ed6d3-4e, col_values=(('qos', UUID('cfef3023-1152-4901-8d8d-55ed188b5b17')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe3ed6d3-4e, col_values=(('external_ids', {'iface-id': 'fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:64:63', 'vm-uuid': 'dc135ee2-5e7b-44ce-aaa4-5471a49edc7d'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:53 user nova-compute[74739]: INFO os_vif [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e')
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:06:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No VIF found with MAC fa:16:3e:f8:64:63, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:06:54 user nova-compute[74739]: DEBUG nova.network.neutron [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updated VIF entry in instance network info cache for port fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:06:54 user nova-compute[74739]: DEBUG nova.network.neutron [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:06:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4f5b2019-a756-4157-a5fc-0a84925c505e req-072e0e2e-a4b9-4a1a-96dd-2566011d4f87 service nova] Releasing lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] No waiting events found dispatching network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:55 user nova-compute[74739]: WARNING nova.compute.manager [req-9aabce42-2862-4a2e-b67a-b56b3dfb3978 req-4d465ebb-2caa-4593-83c1-33b373d109c7 service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received unexpected event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 for instance with vm_state building and task_state spawning.
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:06:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Instance spawned successfully.
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:06:57 user nova-compute[74739]: INFO nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] No waiting events found dispatching network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:06:57 user nova-compute[74739]: WARNING nova.compute.manager [req-a35d2e34-2986-441d-b21b-321ad8edecec req-2f921e82-f06d-4fad-9f0c-5e2e001da58c service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received unexpected event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 for instance with vm_state building and task_state spawning.
Oct 25 18:06:57 user nova-compute[74739]: INFO nova.compute.manager [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Took 6.07 seconds to build instance.
Oct 25 18:06:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b906f93f-d756-42cb-86c4-093845f4a0ca tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.181s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:06:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:04 user nova-compute[74739]: INFO nova.compute.manager [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Terminating instance
Oct 25 18:07:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-unplugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] No waiting events found dispatching network-vif-unplugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-8e152e3a-7d57-4c2d-8760-0ec326b3b5c6 req-53544766-5526-40b6-963a-950240c09544 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-unplugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:07:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Instance destroyed successfully.
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lazy-loading 'resources' on Instance uuid c463c6be-cd71-4bd9-9b83-7485d5ff9afd {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T17:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681183607',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681183607',id=2,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T17:47:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ed00ba170e845c8ad57fe410d8388b7',ramdisk_id='',reservation_id='r-7puwktqu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T17:49:19Z,user_data=None,user_id='964d6de8a5b7400ea3a45d666a499632',uuid=c463c6be-cd71-4bd9-9b83-7485d5ff9afd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converting VIF {"id": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "address": "fa:16:3e:32:7d:54", "network": {"id": "cf50127b-2acf-4c0c-bfe2-82ac68cf91b8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-215569430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ed00ba170e845c8ad57fe410d8388b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8bd265f-f5", "ovs_interfaceid": "a8bd265f-f516-4bd8-93bd-4c9ac13fa341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG os_vif [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8bd265f-f5, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77af829f-cb56-4c78-93dc-aa487dc553e0) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: INFO os_vif [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:7d:54,bridge_name='br-int',has_traffic_filtering=True,id=a8bd265f-f516-4bd8-93bd-4c9ac13fa341,network=Network(cf50127b-2acf-4c0c-bfe2-82ac68cf91b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8bd265f-f5')
Oct 25 18:07:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Deleting instance files /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd_del
Oct 25 18:07:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Deletion of /opt/stack/data/nova/instances/c463c6be-cd71-4bd9-9b83-7485d5ff9afd_del complete
Oct 25 18:07:05 user nova-compute[74739]: INFO nova.compute.manager [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 18:07:05 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:05 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Took 0.66 seconds to deallocate network for instance.
Oct 25 18:07:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-74e5119f-7dcc-4018-ace5-db6bfba535cb req-96b05b23-2f03-495d-ae7e-3fe0538cd23a service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-deleted-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:06 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Deleted allocations for instance c463c6be-cd71-4bd9-9b83-7485d5ff9afd
Oct 25 18:07:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f4ce2717-9050-4285-b73d-6326dfa22b3a tempest-ServerBootFromVolumeStableRescueTest-1201378770 tempest-ServerBootFromVolumeStableRescueTest-1201378770-project-member] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] Acquiring lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] Lock "c463c6be-cd71-4bd9-9b83-7485d5ff9afd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] No waiting events found dispatching network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:06 user nova-compute[74739]: WARNING nova.compute.manager [req-126ba640-8088-42f1-9bfa-31238e71548d req-4ddc0009-c660-4a0f-b374-53417e845ed2 service nova] [instance: c463c6be-cd71-4bd9-9b83-7485d5ff9afd] Received unexpected event network-vif-plugged-a8bd265f-f516-4bd8-93bd-4c9ac13fa341 for instance with vm_state deleted and task_state None.
Oct 25 18:07:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:07:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:07:19 user nova-compute[74739]: INFO nova.compute.claims [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Claim successful on node user
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:07:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.policy [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eabf9c2553e7486abc8e3ad8d319de31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aadec151f7634875b425e757c5997e77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:07:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Creating image(s)
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "/opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "/opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:19 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk 1073741824" returned: 0 in 0.049s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Cannot resize image /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Ensure instance console log exists: /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Successfully created port: b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:07:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:21 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.110679626464844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Successfully updated port: b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquired lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-changed-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Refreshing instance network info cache due to event network-changed-b246d5fd-aa34-4191-bc43-600c0777db65. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] Acquiring lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating instance_info_cache with network_info: [{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Releasing lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Instance network_info: |[{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] Acquired lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Refreshing network info cache for port b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Start _get_guest_xml network_info=[{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:07:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2126427162',display_name='tempest-SnapshotDataIntegrityTests-server-2126427162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2126427162',id=33,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISfm+lLprnNMnwr8si2QGlYDRM/QCIOctgtgHiDBRx7l31aye1sskuevvumEvhy/SckJhHH77muzlxjdoUaUGy0FSN+WQ8mwFtv46jFpfoe1dQtBbbkPOqjUMYjdkoI4Q==',key_name='tempest-keypair-1852589154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aadec151f7634875b425e757c5997e77',ramdisk_id='',reservation_id='r-93k40ora',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1913790297',owner_user_name='tempest-SnapshotDataIntegrityTests-1913790297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabf9c2553e7486abc8e3ad8d319de31',uuid=4a3046fd-9f36-420a-a8ca-e487df8a7db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converting VIF {"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:07:22 user nova-compute[74739]:   <uuid>4a3046fd-9f36-420a-a8ca-e487df8a7db7</uuid>
Oct 25 18:07:22 user nova-compute[74739]:   <name>instance-00000021</name>
Oct 25 18:07:22 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:07:22 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:07:22 user nova-compute[74739]:   <metadata>
Oct 25 18:07:22 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:07:22 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2126427162</nova:name>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:07:22</nova:creationTime>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:07:22 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:07:22 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:owner>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:user uuid="eabf9c2553e7486abc8e3ad8d319de31">tempest-SnapshotDataIntegrityTests-1913790297-project-member</nova:user>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:project uuid="aadec151f7634875b425e757c5997e77">tempest-SnapshotDataIntegrityTests-1913790297</nova:project>
Oct 25 18:07:22 user nova-compute[74739]:       </nova:owner>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:07:22 user nova-compute[74739]:       <nova:ports>
Oct 25 18:07:22 user nova-compute[74739]:         <nova:port uuid="b246d5fd-aa34-4191-bc43-600c0777db65">
Oct 25 18:07:22 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 18:07:22 user nova-compute[74739]:         </nova:port>
Oct 25 18:07:22 user nova-compute[74739]:       </nova:ports>
Oct 25 18:07:22 user nova-compute[74739]:     </nova:instance>
Oct 25 18:07:22 user nova-compute[74739]:   </metadata>
Oct 25 18:07:22 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:07:22 user nova-compute[74739]:     <system>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="serial">4a3046fd-9f36-420a-a8ca-e487df8a7db7</entry>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="uuid">4a3046fd-9f36-420a-a8ca-e487df8a7db7</entry>
Oct 25 18:07:22 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:07:22 user nova-compute[74739]:     </system>
Oct 25 18:07:22 user nova-compute[74739]:   </sysinfo>
Oct 25 18:07:22 user nova-compute[74739]:   <os>
Oct 25 18:07:22 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:07:22 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:07:22 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:07:22 user nova-compute[74739]:   </os>
Oct 25 18:07:22 user nova-compute[74739]:   <features>
Oct 25 18:07:22 user nova-compute[74739]:     <acpi/>
Oct 25 18:07:22 user nova-compute[74739]:     <apic/>
Oct 25 18:07:22 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:07:22 user nova-compute[74739]:   </features>
Oct 25 18:07:22 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:07:22 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:07:22 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:07:22 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:07:22 user nova-compute[74739]:   </clock>
Oct 25 18:07:22 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:07:22 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:07:22 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:07:22 user nova-compute[74739]:   </cpu>
Oct 25 18:07:22 user nova-compute[74739]:   <devices>
Oct 25 18:07:22 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:07:22 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:07:22 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk"/>
Oct 25 18:07:22 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:07:22 user nova-compute[74739]:     </disk>
Oct 25 18:07:22 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:07:22 user nova-compute[74739]:       <mac address="fa:16:3e:d5:12:89"/>
Oct 25 18:07:22 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:07:22 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:07:22 user nova-compute[74739]:       <target dev="tapb246d5fd-aa"/>
Oct 25 18:07:22 user nova-compute[74739]:     </interface>
Oct 25 18:07:22 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:07:22 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/console.log" append="off"/>
Oct 25 18:07:22 user nova-compute[74739]:     </serial>
Oct 25 18:07:22 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:07:22 user nova-compute[74739]:     <video>
Oct 25 18:07:22 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:07:22 user nova-compute[74739]:     </video>
Oct 25 18:07:22 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:07:22 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:07:22 user nova-compute[74739]:     </rng>
Oct 25 18:07:22 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:07:22 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:07:22 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:07:22 user nova-compute[74739]:     </memballoon>
Oct 25 18:07:22 user nova-compute[74739]:   </devices>
Oct 25 18:07:22 user nova-compute[74739]: </domain>
Oct 25 18:07:22 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2126427162',display_name='tempest-SnapshotDataIntegrityTests-server-2126427162',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2126427162',id=33,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISfm+lLprnNMnwr8si2QGlYDRM/QCIOctgtgHiDBRx7l31aye1sskuevvumEvhy/SckJhHH77muzlxjdoUaUGy0FSN+WQ8mwFtv46jFpfoe1dQtBbbkPOqjUMYjdkoI4Q==',key_name='tempest-keypair-1852589154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aadec151f7634875b425e757c5997e77',ramdisk_id='',reservation_id='r-93k40ora',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1913790297',owner_user_name='tempest-SnapshotDataIntegrityTests-1913790297-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:07:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabf9c2553e7486abc8e3ad8d319de31',uuid=4a3046fd-9f36-420a-a8ca-e487df8a7db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converting VIF {"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG os_vif [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8335f481-406c-50d1-b997-0596a808add8', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb246d5fd-aa, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb246d5fd-aa, col_values=(('qos', UUID('3b26831d-a4db-4267-a558-268f0c7f350f')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb246d5fd-aa, col_values=(('external_ids', {'iface-id': 'b246d5fd-aa34-4191-bc43-600c0777db65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:12:89', 'vm-uuid': '4a3046fd-9f36-420a-a8ca-e487df8a7db7'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:22 user nova-compute[74739]: INFO os_vif [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa')
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No VIF found with MAC fa:16:3e:d5:12:89, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updated VIF entry in instance network info cache for port b246d5fd-aa34-4191-bc43-600c0777db65. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating instance_info_cache with network_info: [{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-fe8d6273-8290-4dc3-a069-9c2f0da7b30b req-516755e5-d96d-4a3f-aca6-b25947536f10 service nova] Releasing lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:07:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Instance spawned successfully.
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:26 user nova-compute[74739]: INFO nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Took 6.31 seconds to spawn the instance on the hypervisor.
Oct 25 18:07:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:07:26 user nova-compute[74739]: INFO nova.compute.manager [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Took 7.11 seconds to build instance.
Oct 25 18:07:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6c08b80f-ad53-4d2c-9848-898d942f6a87 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG nova.compute.manager [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:27 user nova-compute[74739]: WARNING nova.compute.manager [req-8c9a6735-01c1-44f6-ac1a-d562a6c70398 req-04057cd7-d722-4c14-b959-aa40c49f921f service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state active and task_state None.
Oct 25 18:07:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:07:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:29 user nova-compute[74739]: WARNING nova.compute.manager [req-ccfb856a-032f-4118-806d-645900537a17 req-0b83caf4-4e48-465d-833d-f3b59fd55745 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state active and task_state None.
Oct 25 18:07:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:07:30 user nova-compute[74739]: INFO nova.compute.claims [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Claim successful on node user
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:07:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.policy [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d4d5064cac7433aaf39069b94163ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c27c568e254f4e91bb7bc005ecbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:07:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Creating image(s)
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "/opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "/opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "/opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.200s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk 1073741824" returned: 0 in 0.061s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Successfully created port: de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Cannot resize image /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Ensure instance console log exists: /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Successfully updated port: de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquired lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-changed-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing instance network info cache due to event network-changed-de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] Acquiring lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Releasing lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Instance network_info: |[{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] Acquired lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing network info cache for port de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Start _get_guest_xml network_info=[{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:07:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1640698855',display_name='tempest-TestStampPattern-server-1640698855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1640698855',id=34,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-cw54k07p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:07:31Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=e855c899-da17-49db-a2cd-e9166467e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'pci_devices' on Instance uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:07:33 user nova-compute[74739]:   <uuid>e855c899-da17-49db-a2cd-e9166467e0fa</uuid>
Oct 25 18:07:33 user nova-compute[74739]:   <name>instance-00000022</name>
Oct 25 18:07:33 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:07:33 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:07:33 user nova-compute[74739]:   <metadata>
Oct 25 18:07:33 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:07:33 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:name>tempest-TestStampPattern-server-1640698855</nova:name>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:07:33</nova:creationTime>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:07:33 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:07:33 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:owner>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:user uuid="3d4d5064cac7433aaf39069b94163ce0">tempest-TestStampPattern-156821719-project-member</nova:user>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:project uuid="77c27c568e254f4e91bb7bc005ecbbf0">tempest-TestStampPattern-156821719</nova:project>
Oct 25 18:07:33 user nova-compute[74739]:       </nova:owner>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:07:33 user nova-compute[74739]:       <nova:ports>
Oct 25 18:07:33 user nova-compute[74739]:         <nova:port uuid="de08c67a-95c4-42ca-b133-29eec772daea">
Oct 25 18:07:33 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 18:07:33 user nova-compute[74739]:         </nova:port>
Oct 25 18:07:33 user nova-compute[74739]:       </nova:ports>
Oct 25 18:07:33 user nova-compute[74739]:     </nova:instance>
Oct 25 18:07:33 user nova-compute[74739]:   </metadata>
Oct 25 18:07:33 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:07:33 user nova-compute[74739]:     <system>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="serial">e855c899-da17-49db-a2cd-e9166467e0fa</entry>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="uuid">e855c899-da17-49db-a2cd-e9166467e0fa</entry>
Oct 25 18:07:33 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:07:33 user nova-compute[74739]:     </system>
Oct 25 18:07:33 user nova-compute[74739]:   </sysinfo>
Oct 25 18:07:33 user nova-compute[74739]:   <os>
Oct 25 18:07:33 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:07:33 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:07:33 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:07:33 user nova-compute[74739]:   </os>
Oct 25 18:07:33 user nova-compute[74739]:   <features>
Oct 25 18:07:33 user nova-compute[74739]:     <acpi/>
Oct 25 18:07:33 user nova-compute[74739]:     <apic/>
Oct 25 18:07:33 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:07:33 user nova-compute[74739]:   </features>
Oct 25 18:07:33 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:07:33 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:07:33 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:07:33 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:07:33 user nova-compute[74739]:   </clock>
Oct 25 18:07:33 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:07:33 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:07:33 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:07:33 user nova-compute[74739]:   </cpu>
Oct 25 18:07:33 user nova-compute[74739]:   <devices>
Oct 25 18:07:33 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:07:33 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:07:33 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk"/>
Oct 25 18:07:33 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:07:33 user nova-compute[74739]:     </disk>
Oct 25 18:07:33 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:07:33 user nova-compute[74739]:       <mac address="fa:16:3e:47:32:5e"/>
Oct 25 18:07:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:07:33 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:07:33 user nova-compute[74739]:       <target dev="tapde08c67a-95"/>
Oct 25 18:07:33 user nova-compute[74739]:     </interface>
Oct 25 18:07:33 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:07:33 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/console.log" append="off"/>
Oct 25 18:07:33 user nova-compute[74739]:     </serial>
Oct 25 18:07:33 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:07:33 user nova-compute[74739]:     <video>
Oct 25 18:07:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:07:33 user nova-compute[74739]:     </video>
Oct 25 18:07:33 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:07:33 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:07:33 user nova-compute[74739]:     </rng>
Oct 25 18:07:33 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:07:33 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:07:33 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:07:33 user nova-compute[74739]:     </memballoon>
Oct 25 18:07:33 user nova-compute[74739]:   </devices>
Oct 25 18:07:33 user nova-compute[74739]: </domain>
Oct 25 18:07:33 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1640698855',display_name='tempest-TestStampPattern-server-1640698855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1640698855',id=34,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-cw54k07p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:07:31Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=e855c899-da17-49db-a2cd-e9166467e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG os_vif [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e71e4e0e-f1e1-5ea9-9f66-43913d273f8f', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde08c67a-95, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde08c67a-95, col_values=(('qos', UUID('1cd78fe5-b8fa-4596-8217-f8c37a927578')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde08c67a-95, col_values=(('external_ids', {'iface-id': 'de08c67a-95c4-42ca-b133-29eec772daea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:32:5e', 'vm-uuid': 'e855c899-da17-49db-a2cd-e9166467e0fa'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:33 user nova-compute[74739]: INFO os_vif [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95')
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:07:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No VIF found with MAC fa:16:3e:47:32:5e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:07:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updated VIF entry in instance network info cache for port de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:07:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-491a7aad-7d58-4f7c-b444-ffd876060bf9 req-69aebc38-55c5-4c48-95ed-9faf2dae4ca8 service nova] Releasing lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] No waiting events found dispatching network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:35 user nova-compute[74739]: WARNING nova.compute.manager [req-e3e6b33e-2e19-49bb-874d-76a832793ecf req-a2c6f3a9-5730-41f8-902b-ab18ce1256e6 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received unexpected event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea for instance with vm_state building and task_state spawning.
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.compute.manager [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.compute.manager [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing instance network info cache due to event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:07:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Instance spawned successfully.
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:07:37 user nova-compute[74739]: INFO nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 25 18:07:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:07:37 user nova-compute[74739]: INFO nova.compute.manager [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Took 6.79 seconds to build instance.
Oct 25 18:07:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-67616f3d-824a-4244-bc88-3471d45d1e42 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.904s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] No waiting events found dispatching network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:07:38 user nova-compute[74739]: WARNING nova.compute.manager [req-a49eaf68-3e30-48d4-9ae8-9eb1d790a861 req-dae60400-fbf5-4696-9c9f-b372e07e0e8b service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received unexpected event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea for instance with vm_state active and task_state None.
Oct 25 18:07:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated VIF entry in instance network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7a45cb91-45f5-40c5-b682-5b34257e912e req-2a13f427-c102-4959-9ada-f18898f5cce7 service nova] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:07:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:08:06 user nova-compute[74739]: INFO nova.compute.claims [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Claim successful on node user
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:08:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.policy [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fc3ef31d7e6446ea7f8667172ce012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6417911f3bca47d08fbc396de0d54266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:08:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Creating image(s)
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:08:06 user nova-compute[74739]: INFO nova.compute.claims [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Claim successful on node user
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Successfully created port: 7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk 1073741824" returned: 0 in 0.053s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.234s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:08:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Cannot resize image /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Ensure instance console log exists: /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:08:07 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Creating image(s)
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG nova.policy [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fc3ef31d7e6446ea7f8667172ce012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6417911f3bca47d08fbc396de0d54266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:07 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk 1073741824" returned: 0 in 0.047s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Successfully updated port: 7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-changed-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.compute.manager [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Refreshing instance network info cache due to event network-changed-7ff5936a-a844-4cc9-abb9-f0e591e57e23. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Cannot resize image /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Ensure instance console log exists: /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance network_info: |[{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Successfully created port: eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.neutron [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Refreshing network info cache for port 7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start _get_guest_xml network_info=[{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:08:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416959544',display_name='tempest-ServerRescueNegativeTestJSON-server-1416959544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416959544',id=35,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-qk44zhze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:07Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=5eea09f6-2a67-47d3-ba47-356a73a68b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:08:08 user nova-compute[74739]:   <uuid>5eea09f6-2a67-47d3-ba47-356a73a68b67</uuid>
Oct 25 18:08:08 user nova-compute[74739]:   <name>instance-00000023</name>
Oct 25 18:08:08 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:08:08 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:08:08 user nova-compute[74739]:   <metadata>
Oct 25 18:08:08 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:08:08 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1416959544</nova:name>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:08:08</nova:creationTime>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:08:08 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:08:08 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:owner>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:08:08 user nova-compute[74739]:       </nova:owner>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:08:08 user nova-compute[74739]:       <nova:ports>
Oct 25 18:08:08 user nova-compute[74739]:         <nova:port uuid="7ff5936a-a844-4cc9-abb9-f0e591e57e23">
Oct 25 18:08:08 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 18:08:08 user nova-compute[74739]:         </nova:port>
Oct 25 18:08:08 user nova-compute[74739]:       </nova:ports>
Oct 25 18:08:08 user nova-compute[74739]:     </nova:instance>
Oct 25 18:08:08 user nova-compute[74739]:   </metadata>
Oct 25 18:08:08 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:08:08 user nova-compute[74739]:     <system>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="serial">5eea09f6-2a67-47d3-ba47-356a73a68b67</entry>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="uuid">5eea09f6-2a67-47d3-ba47-356a73a68b67</entry>
Oct 25 18:08:08 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:08:08 user nova-compute[74739]:     </system>
Oct 25 18:08:08 user nova-compute[74739]:   </sysinfo>
Oct 25 18:08:08 user nova-compute[74739]:   <os>
Oct 25 18:08:08 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:08:08 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:08:08 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:08:08 user nova-compute[74739]:   </os>
Oct 25 18:08:08 user nova-compute[74739]:   <features>
Oct 25 18:08:08 user nova-compute[74739]:     <acpi/>
Oct 25 18:08:08 user nova-compute[74739]:     <apic/>
Oct 25 18:08:08 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:08:08 user nova-compute[74739]:   </features>
Oct 25 18:08:08 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:08:08 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:08:08 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:08:08 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:08:08 user nova-compute[74739]:   </clock>
Oct 25 18:08:08 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:08:08 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:08:08 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:08:08 user nova-compute[74739]:   </cpu>
Oct 25 18:08:08 user nova-compute[74739]:   <devices>
Oct 25 18:08:08 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:08:08 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:08:08 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk"/>
Oct 25 18:08:08 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:08:08 user nova-compute[74739]:     </disk>
Oct 25 18:08:08 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:08:08 user nova-compute[74739]:       <mac address="fa:16:3e:77:40:01"/>
Oct 25 18:08:08 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:08 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:08:08 user nova-compute[74739]:       <target dev="tap7ff5936a-a8"/>
Oct 25 18:08:08 user nova-compute[74739]:     </interface>
Oct 25 18:08:08 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:08:08 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/console.log" append="off"/>
Oct 25 18:08:08 user nova-compute[74739]:     </serial>
Oct 25 18:08:08 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:08:08 user nova-compute[74739]:     <video>
Oct 25 18:08:08 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:08 user nova-compute[74739]:     </video>
Oct 25 18:08:08 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:08:08 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:08:08 user nova-compute[74739]:     </rng>
Oct 25 18:08:08 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:08:08 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:08:08 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:08:08 user nova-compute[74739]:     </memballoon>
Oct 25 18:08:08 user nova-compute[74739]:   </devices>
Oct 25 18:08:08 user nova-compute[74739]: </domain>
Oct 25 18:08:08 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416959544',display_name='tempest-ServerRescueNegativeTestJSON-server-1416959544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416959544',id=35,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-qk44zhze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:07Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=5eea09f6-2a67-47d3-ba47-356a73a68b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG os_vif [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dce97486-8db3-5372-9ad9-7089a2d090e4', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff5936a-a8, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ff5936a-a8, col_values=(('qos', UUID('f1c814a5-26aa-417c-9b75-bcb3a8eb2fce')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ff5936a-a8, col_values=(('external_ids', {'iface-id': '7ff5936a-a844-4cc9-abb9-f0e591e57e23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:40:01', 'vm-uuid': '5eea09f6-2a67-47d3-ba47-356a73a68b67'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:09 user nova-compute[74739]: INFO os_vif [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8')
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:77:40:01, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updated VIF entry in instance network info cache for port 7ff5936a-a844-4cc9-abb9-f0e591e57e23. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3df31fcd-850d-4aff-ba81-6356c3cd6d86 req-21eebbab-9765-4e65-947e-1ea68dc25209 service nova] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Successfully updated port: eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:08:09 user nova-compute[74739]: DEBUG nova.network.neutron [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance network_info: |[{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start _get_guest_xml network_info=[{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:08:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1908841081',display_name='tempest-ServerRescueNegativeTestJSON-server-1908841081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1908841081',id=36,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-0c6gh0pf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:08Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:08:10 user nova-compute[74739]:   <uuid>b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</uuid>
Oct 25 18:08:10 user nova-compute[74739]:   <name>instance-00000024</name>
Oct 25 18:08:10 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:08:10 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:08:10 user nova-compute[74739]:   <metadata>
Oct 25 18:08:10 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:08:10 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1908841081</nova:name>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:08:10</nova:creationTime>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:08:10 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:08:10 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:owner>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:08:10 user nova-compute[74739]:       </nova:owner>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:08:10 user nova-compute[74739]:       <nova:ports>
Oct 25 18:08:10 user nova-compute[74739]:         <nova:port uuid="eaf39225-a413-43c6-b9d1-04e9bf193d39">
Oct 25 18:08:10 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 18:08:10 user nova-compute[74739]:         </nova:port>
Oct 25 18:08:10 user nova-compute[74739]:       </nova:ports>
Oct 25 18:08:10 user nova-compute[74739]:     </nova:instance>
Oct 25 18:08:10 user nova-compute[74739]:   </metadata>
Oct 25 18:08:10 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:08:10 user nova-compute[74739]:     <system>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="serial">b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</entry>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="uuid">b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</entry>
Oct 25 18:08:10 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:08:10 user nova-compute[74739]:     </system>
Oct 25 18:08:10 user nova-compute[74739]:   </sysinfo>
Oct 25 18:08:10 user nova-compute[74739]:   <os>
Oct 25 18:08:10 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:08:10 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:08:10 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:08:10 user nova-compute[74739]:   </os>
Oct 25 18:08:10 user nova-compute[74739]:   <features>
Oct 25 18:08:10 user nova-compute[74739]:     <acpi/>
Oct 25 18:08:10 user nova-compute[74739]:     <apic/>
Oct 25 18:08:10 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:08:10 user nova-compute[74739]:   </features>
Oct 25 18:08:10 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:08:10 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:08:10 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:08:10 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:08:10 user nova-compute[74739]:   </clock>
Oct 25 18:08:10 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:08:10 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:08:10 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:08:10 user nova-compute[74739]:   </cpu>
Oct 25 18:08:10 user nova-compute[74739]:   <devices>
Oct 25 18:08:10 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:08:10 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:08:10 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk"/>
Oct 25 18:08:10 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:08:10 user nova-compute[74739]:     </disk>
Oct 25 18:08:10 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:08:10 user nova-compute[74739]:       <mac address="fa:16:3e:1e:74:68"/>
Oct 25 18:08:10 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:10 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:08:10 user nova-compute[74739]:       <target dev="tapeaf39225-a4"/>
Oct 25 18:08:10 user nova-compute[74739]:     </interface>
Oct 25 18:08:10 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:08:10 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/console.log" append="off"/>
Oct 25 18:08:10 user nova-compute[74739]:     </serial>
Oct 25 18:08:10 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:08:10 user nova-compute[74739]:     <video>
Oct 25 18:08:10 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:10 user nova-compute[74739]:     </video>
Oct 25 18:08:10 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:08:10 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:08:10 user nova-compute[74739]:     </rng>
Oct 25 18:08:10 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:08:10 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:08:10 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:08:10 user nova-compute[74739]:     </memballoon>
Oct 25 18:08:10 user nova-compute[74739]:   </devices>
Oct 25 18:08:10 user nova-compute[74739]: </domain>
Oct 25 18:08:10 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1908841081',display_name='tempest-ServerRescueNegativeTestJSON-server-1908841081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1908841081',id=36,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-0c6gh0pf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:08Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG os_vif [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3efd915a-841a-5dd1-bf1c-5d6dc2e243ce', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaf39225-a4, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaf39225-a4, col_values=(('qos', UUID('b55f6130-c986-4db0-bde1-06f08786b20b')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaf39225-a4, col_values=(('external_ids', {'iface-id': 'eaf39225-a413-43c6-b9d1-04e9bf193d39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:74:68', 'vm-uuid': 'b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: INFO os_vif [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4')
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:1e:74:68, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-changed-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Refreshing instance network info cache due to event network-changed-eaf39225-a413-43c6-b9d1-04e9bf193d39. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Refreshing network info cache for port eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:10 user nova-compute[74739]: WARNING nova.compute.manager [req-6868adb3-db12-4b32-904e-eac068415f47 req-b8591c85-c26f-4008-ac40-a176caedde94 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state building and task_state spawning.
Oct 25 18:08:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG nova.network.neutron [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updated VIF entry in instance network info cache for port eaf39225-a413-43c6-b9d1-04e9bf193d39. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG nova.network.neutron [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f51e6f83-da06-4376-b5f9-15d1f958da34 req-d6701174-6d36-49ed-85f2-1cf20304dc9a service nova] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:11 user nova-compute[74739]: INFO nova.compute.manager [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Unshelving
Oct 25 18:08:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:11 user nova-compute[74739]: INFO nova.virt.block_device [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Booting with volume 7edb1d67-fea4-4102-92cb-7831f1137db2 at /dev/vda
Oct 25 18:08:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bcb38d-0902-4402-a1fb-171472041936]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc14a5-5d13-4f83-a280-3005ff8b51ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b3859b-5ccc-42bf-aaf0-35bc248ea2f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15824727-f3e1-448f-918f-466a9df8ec98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:12 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0bce45-7698-4cd6-8ebe-fde81896d8fc]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG os_brick.utils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating existing volume attachment record: ad2dc38e-024b-4db8-affe-d3fb540e1601 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:12 user nova-compute[74739]: WARNING nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state building and task_state spawning.
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:12 user nova-compute[74739]: WARNING nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state building and task_state spawning.
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:12 user nova-compute[74739]: WARNING nova.compute.manager [req-d9887ba2-1ba6-4770-bf6f-db103f3f5c85 req-1134cd46-0a84-4fb1-a68b-39a64f3061e8 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state building and task_state spawning.
Oct 25 18:08:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:08:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance spawned successfully.
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:13 user nova-compute[74739]: INFO nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Took 7.16 seconds to spawn the instance on the hypervisor.
Oct 25 18:08:13 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:08:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:13 user nova-compute[74739]: INFO nova.compute.manager [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Took 7.83 seconds to build instance.
Oct 25 18:08:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b1442abc-8740-43bd-965d-b37080af193b tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.984s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:08:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance spawned successfully.
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:14 user nova-compute[74739]: INFO nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Took 6.66 seconds to spawn the instance on the hypervisor.
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:08:14 user nova-compute[74739]: INFO nova.compute.manager [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Took 7.56 seconds to build instance.
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-bc9d6e8d-ac9a-45ed-97fb-2395c66d2f2d tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.661s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:08:14 user nova-compute[74739]: INFO nova.compute.claims [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Claim successful on node user
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:08:14 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:08:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:08:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:08:15 user nova-compute[74739]: DEBUG nova.policy [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:08:15 user nova-compute[74739]: INFO nova.virt.block_device [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Booting with volume snapshot 084c623b-445c-4d85-b473-5b1f67bcbc7e at /dev/vda
Oct 25 18:08:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:15 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Successfully created port: cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Successfully updated port: cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-changed-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Refreshing instance network info cache due to event network-changed-cba74939-cffc-47fa-b4fe-07120fcb62b6. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] Acquiring lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.network.neutron [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Updating instance_info_cache with network_info: [{"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Instance network_info: |[{"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] Acquired lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:16 user nova-compute[74739]: DEBUG nova.network.neutron [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Refreshing network info cache for port cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG nova.network.neutron [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Updated VIF entry in instance network info cache for port cba74939-cffc-47fa-b4fe-07120fcb62b6. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG nova.network.neutron [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Updating instance_info_cache with network_info: [{"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d4e66fb-092f-48b8-86c4-35ab3e0a320d req-a8355dc1-8a8c-4e3d-8be0-ffa242ea8563 service nova] Releasing lock "refresh_cache-1a66ffb7-3634-4211-93f1-17357a1d29e7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:17 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:08:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:08:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:08:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:08:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 3 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:08:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deletion of /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize failed
Oct 25 18:08:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:23 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8232MB free_disk=25.045631408691406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:08:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 70725b4e-ae2c-4bc9-895c-31cb52123810 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 1a66ffb7-3634-4211-93f1-17357a1d29e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:08:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG os_brick.utils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:08:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923735d-23e7-446b-b7e6-50f17908815e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4263b70-40e3-457c-b44e-00013c595929]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0049c0-e092-4360-abf5-3182ceffa4ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d175b34-c1d2-4433-b7b1-022edfde4e08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:26 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:08:26 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c96afed-418e-442c-9fd8-c93535210ed2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG os_brick.utils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:08:26 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Updating existing volume attachment record: 8200072f-0cca-4ec8-bb0d-c15f4892f888 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'pci_requests' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'numa_topology' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:08:30 user nova-compute[74739]: INFO nova.compute.claims [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Claim successful on node user
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:30 user nova-compute[74739]: INFO nova.network.neutron [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 25 18:08:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing instance network info cache due to event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:08:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Creating image(s)
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Ensure instance console log exists: /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start _get_guest_xml network_info=[{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'ad2dc38e-024b-4db8-affe-d3fb540e1601', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70725b4e-ae2c-4bc9-895c-31cb52123810', 'attached_at': '', 'detached_at': '', 'volume_id': '7edb1d67-fea4-4102-92cb-7831f1137db2', 'serial': '7edb1d67-fea4-4102-92cb-7831f1137db2'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:08:31 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:31 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'vcpu_model' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.objects.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Object Instance<70725b4e-ae2c-4bc9-895c-31cb52123810> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:08:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:08:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:08:31 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6726670-f5b8-4613-8530-35d87e7b46dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:08:31 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45cf124-434b-4e66-b297-8d989ddfba2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2] added
Oct 25 18:08:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9bec2-6b0b-4a5d-b932-22e82d5fea95]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58596d9-9186-4488-80e1-fcbbc4e4b912]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxDjkIwe {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gxDjkIwe" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba136dd-70ff-4eb2-b774-8b5f8d7b3d6b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gxDjkIwe'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c309bfd7-cbf6-43f8-b0ec-dac9a5330952]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd8f2b-a3eb-49ff-84c6-71c0558fb696]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:08:31 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:08:31 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:08:31 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:08:31 user nova-compute[74739]: 
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b73be66-7a59-4e1b-b360-e2160aa8bc45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]
Oct 25 18:08:31 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.
Oct 25 18:08:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac0597-faee-4c14-8733-19b1d3811d2d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea54072-eae4-43f5-bb97-9abc860f767d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:08:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c87081-0bb2-4791-ab44-f38d7144e992]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated VIF entry in instance network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c3f7950-44f4-47b8-aadb-3a97475c3c56 req-7ae64131-ee21-40e4-9aea-dba528d4efd4 service nova] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26464663665303266', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464663665303266', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1529691634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:08:12Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'pci_devices' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.objects.base [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Object Instance<70725b4e-ae2c-4bc9-895c-31cb52123810> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:08:33 user nova-compute[74739]:   <uuid>70725b4e-ae2c-4bc9-895c-31cb52123810</uuid>
Oct 25 18:08:33 user nova-compute[74739]:   <name>instance-0000001e</name>
Oct 25 18:08:33 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:08:33 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:08:33 user nova-compute[74739]:   <metadata>
Oct 25 18:08:33 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:08:33 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:08:33 user nova-compute[74739]:       <nova:name>tempest-TestShelveInstance-server-279757795</nova:name>
Oct 25 18:08:33 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:08:31</nova:creationTime>
Oct 25 18:08:33 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:08:33 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:08:33 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:08:33 user nova-compute[74739]:       <nova:owner>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:user uuid="d6db74d902fa431fa5d589ecba46f62e">tempest-TestShelveInstance-692370709-project-member</nova:user>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:project uuid="e66ef0c6013c4135859334630a6cef2a">tempest-TestShelveInstance-692370709</nova:project>
Oct 25 18:08:33 user nova-compute[74739]:       </nova:owner>
Oct 25 18:08:33 user nova-compute[74739]:       <nova:ports>
Oct 25 18:08:33 user nova-compute[74739]:         <nova:port uuid="1c4846a2-9a16-42fb-9f57-11f6d1d0f73a">
Oct 25 18:08:33 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 18:08:33 user nova-compute[74739]:         </nova:port>
Oct 25 18:08:33 user nova-compute[74739]:       </nova:ports>
Oct 25 18:08:33 user nova-compute[74739]:     </nova:instance>
Oct 25 18:08:33 user nova-compute[74739]:   </metadata>
Oct 25 18:08:33 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:08:33 user nova-compute[74739]:     <system>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="serial">70725b4e-ae2c-4bc9-895c-31cb52123810</entry>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="uuid">70725b4e-ae2c-4bc9-895c-31cb52123810</entry>
Oct 25 18:08:33 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:08:33 user nova-compute[74739]:     </system>
Oct 25 18:08:33 user nova-compute[74739]:   </sysinfo>
Oct 25 18:08:33 user nova-compute[74739]:   <os>
Oct 25 18:08:33 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:08:33 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:08:33 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:08:33 user nova-compute[74739]:   </os>
Oct 25 18:08:33 user nova-compute[74739]:   <features>
Oct 25 18:08:33 user nova-compute[74739]:     <acpi/>
Oct 25 18:08:33 user nova-compute[74739]:     <apic/>
Oct 25 18:08:33 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:08:33 user nova-compute[74739]:   </features>
Oct 25 18:08:33 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:08:33 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:08:33 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:08:33 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:08:33 user nova-compute[74739]:   </clock>
Oct 25 18:08:33 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:08:33 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:08:33 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:08:33 user nova-compute[74739]:   </cpu>
Oct 25 18:08:33 user nova-compute[74739]:   <devices>
Oct 25 18:08:33 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:08:33 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:08:33 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 18:08:33 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:08:33 user nova-compute[74739]:       <serial>7edb1d67-fea4-4102-92cb-7831f1137db2</serial>
Oct 25 18:08:33 user nova-compute[74739]:     </disk>
Oct 25 18:08:33 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:08:33 user nova-compute[74739]:       <mac address="fa:16:3e:7c:4c:5f"/>
Oct 25 18:08:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:33 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:08:33 user nova-compute[74739]:       <target dev="tap1c4846a2-9a"/>
Oct 25 18:08:33 user nova-compute[74739]:     </interface>
Oct 25 18:08:33 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:08:33 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810/console.log" append="off"/>
Oct 25 18:08:33 user nova-compute[74739]:     </serial>
Oct 25 18:08:33 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:08:33 user nova-compute[74739]:     <video>
Oct 25 18:08:33 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:33 user nova-compute[74739]:     </video>
Oct 25 18:08:33 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:08:33 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:08:33 user nova-compute[74739]:     </rng>
Oct 25 18:08:33 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:08:33 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:08:33 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:08:33 user nova-compute[74739]:     </memballoon>
Oct 25 18:08:33 user nova-compute[74739]:   </devices>
Oct 25 18:08:33 user nova-compute[74739]: </domain>
Oct 25 18:08:33 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1529691634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:04:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:08:12Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG os_vif [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c40faa09-86fc-5f1e-9207-d215f58a5414', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c4846a2-9a, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c4846a2-9a, col_values=(('qos', UUID('a9714b62-c6dd-4302-8527-a7d7c8209453')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c4846a2-9a, col_values=(('external_ids', {'iface-id': '1c4846a2-9a16-42fb-9f57-11f6d1d0f73a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:4c:5f', 'vm-uuid': '70725b4e-ae2c-4bc9-895c-31cb52123810'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:33 user nova-compute[74739]: INFO os_vif [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a')
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:08:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] No VIF found with MAC fa:16:3e:7c:4c:5f, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:34 user nova-compute[74739]: WARNING nova.compute.manager [req-41c1bff8-8175-4ac0-b48f-4a94f40ba4f0 req-1826f774-9206-4f05-b7aa-d07c13153f29 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:08:36 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance spawned successfully.
Oct 25 18:08:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b85cbc03-0b1d-4954-8b9b-a225fd669fd6 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.677s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:36 user nova-compute[74739]: WARNING nova.compute.manager [req-1d8c618e-203a-4a69-969f-7918fb18b648 req-9d0b6997-a85a-42a7-90b4-d1567567a60e service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state active and task_state None.
Oct 25 18:08:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-changed-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Refreshing instance network info cache due to event network-changed-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] Acquiring lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] Acquired lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Refreshing network info cache for port fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updated VIF entry in instance network info cache for port fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG nova.network.neutron [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [{"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:08:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-890c108c-c2e7-4aed-a058-edad4c755a1b req-a8ee135f-f247-44d0-8a05-fae41aa967bd service nova] Releasing lock "refresh_cache-dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:08:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Creating image(s)
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Ensure instance console log exists: /opt/stack/data/nova/instances/1a66ffb7-3634-4211-93f1-17357a1d29e7/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Start _get_guest_xml network_info=[{"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '8200072f-0cca-4ec8-bb0d-c15f4892f888', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dETXkNvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a66ffb7-3634-4211-93f1-17357a1d29e7', 'attached_at': '', 'detached_at': '', 'volume_id': '20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 'serial': '20ad4e3c-f2fc-436f-801b-aea8c4ed19cd'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:08:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dETXkNvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:08:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:08:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:08:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:08:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:08:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:08:43 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:08:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b6785-aca3-4a71-bb1b-2a76ed9ae8c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:08:44 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3086ab-9dd7-4922-bbbe-29335f015b54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd] added
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9798e963-385c-4866-af36-5713f84cf08f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[641766f1-6702-4518-bd19-c3a4893207d3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dETXkNvP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dETXkNvP" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e805fd-645a-4cf2-94d1-1f65ef60b052]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dETXkNvP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eceaedd-0dac-4c01-8a76-c177ce3b6222]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee449d-21d0-4234-a347-0d4c26ceb1bc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d324f53e-48c5-4714-be6c-044a4cebb885]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260]
Oct 25 18:08:44 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260] successful.
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b30eb9f-6d10-4890-9e14-e0b2b00dddaa]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba8b081-f12e-4dbc-9ceb-f8ec98349861]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:44 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:08:44 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:08:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e5992-f401-4593-9646-a58158096fee]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:08:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dETXkNvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23238396464623363', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238396464623363', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082870404',display_name='tempest-TestVolumeBootPattern-server-2082870404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082870404',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-h0tun5d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:15Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=1a66ffb7-3634-4211-93f1-17357a1d29e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a66ffb7-3634-4211-93f1-17357a1d29e7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:08:45 user nova-compute[74739]:   <uuid>1a66ffb7-3634-4211-93f1-17357a1d29e7</uuid>
Oct 25 18:08:45 user nova-compute[74739]:   <name>instance-00000025</name>
Oct 25 18:08:45 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:08:45 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:08:45 user nova-compute[74739]:   <metadata>
Oct 25 18:08:45 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:08:45 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:08:45 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-server-2082870404</nova:name>
Oct 25 18:08:45 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:08:43</nova:creationTime>
Oct 25 18:08:45 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:08:45 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:08:45 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:08:45 user nova-compute[74739]:       <nova:owner>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:08:45 user nova-compute[74739]:       </nova:owner>
Oct 25 18:08:45 user nova-compute[74739]:       <nova:ports>
Oct 25 18:08:45 user nova-compute[74739]:         <nova:port uuid="cba74939-cffc-47fa-b4fe-07120fcb62b6">
Oct 25 18:08:45 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 25 18:08:45 user nova-compute[74739]:         </nova:port>
Oct 25 18:08:45 user nova-compute[74739]:       </nova:ports>
Oct 25 18:08:45 user nova-compute[74739]:     </nova:instance>
Oct 25 18:08:45 user nova-compute[74739]:   </metadata>
Oct 25 18:08:45 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:08:45 user nova-compute[74739]:     <system>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="serial">1a66ffb7-3634-4211-93f1-17357a1d29e7</entry>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="uuid">1a66ffb7-3634-4211-93f1-17357a1d29e7</entry>
Oct 25 18:08:45 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:08:45 user nova-compute[74739]:     </system>
Oct 25 18:08:45 user nova-compute[74739]:   </sysinfo>
Oct 25 18:08:45 user nova-compute[74739]:   <os>
Oct 25 18:08:45 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:08:45 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:08:45 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:08:45 user nova-compute[74739]:   </os>
Oct 25 18:08:45 user nova-compute[74739]:   <features>
Oct 25 18:08:45 user nova-compute[74739]:     <acpi/>
Oct 25 18:08:45 user nova-compute[74739]:     <apic/>
Oct 25 18:08:45 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:08:45 user nova-compute[74739]:   </features>
Oct 25 18:08:45 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:08:45 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:08:45 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:08:45 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:08:45 user nova-compute[74739]:   </clock>
Oct 25 18:08:45 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:08:45 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:08:45 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:08:45 user nova-compute[74739]:   </cpu>
Oct 25 18:08:45 user nova-compute[74739]:   <devices>
Oct 25 18:08:45 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:08:45 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:08:45 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 18:08:45 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:08:45 user nova-compute[74739]:       <serial>20ad4e3c-f2fc-436f-801b-aea8c4ed19cd</serial>
Oct 25 18:08:45 user nova-compute[74739]:     </disk>
Oct 25 18:08:45 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:08:45 user nova-compute[74739]:       <mac address="fa:16:3e:6c:94:03"/>
Oct 25 18:08:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:45 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:08:45 user nova-compute[74739]:       <target dev="tapcba74939-cf"/>
Oct 25 18:08:45 user nova-compute[74739]:     </interface>
Oct 25 18:08:45 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:08:45 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/1a66ffb7-3634-4211-93f1-17357a1d29e7/console.log" append="off"/>
Oct 25 18:08:45 user nova-compute[74739]:     </serial>
Oct 25 18:08:45 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:08:45 user nova-compute[74739]:     <video>
Oct 25 18:08:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:08:45 user nova-compute[74739]:     </video>
Oct 25 18:08:45 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:08:45 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:08:45 user nova-compute[74739]:     </rng>
Oct 25 18:08:45 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:08:45 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:08:45 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:08:45 user nova-compute[74739]:     </memballoon>
Oct 25 18:08:45 user nova-compute[74739]:   </devices>
Oct 25 18:08:45 user nova-compute[74739]: </domain>
Oct 25 18:08:45 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082870404',display_name='tempest-TestVolumeBootPattern-server-2082870404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082870404',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-h0tun5d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:15Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=1a66ffb7-3634-4211-93f1-17357a1d29e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG os_vif [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e2bf2bd-feff-579a-b192-ec22a945b653', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcba74939-cf, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcba74939-cf, col_values=(('qos', UUID('4d12bebc-7fcd-4dc1-9b5e-928aafedaef4')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcba74939-cf, col_values=(('external_ids', {'iface-id': 'cba74939-cffc-47fa-b4fe-07120fcb62b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:94:03', 'vm-uuid': '1a66ffb7-3634-4211-93f1-17357a1d29e7'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:45 user nova-compute[74739]: INFO os_vif [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf')
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:6c:94:03, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:08:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] No waiting events found dispatching network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:47 user nova-compute[74739]: WARNING nova.compute.manager [req-45d140da-092e-46d3-9b1b-94b2b755763f req-d7f7ef66-db36-4eeb-ae3a-4f56293420d2 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received unexpected event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 for instance with vm_state building and task_state spawning.
Oct 25 18:08:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:48 user nova-compute[74739]: INFO nova.compute.manager [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attaching volume dcc17d5f-e29e-4444-b307-917ac431d948 to /dev/vdb
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e19ee-2112-462e-b772-7e14693b0764]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae07d47-a4c2-4cd4-a8aa-817558f252bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f309d1d-6a42-4570-bbd6-f4d3a1f9d875]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c0244-3356-40a8-95ee-702e9453fca2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:08:48 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:08:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cfa48b-cb81-4a15-bb8c-f58698853c69]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:08:48 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating existing volume attachment record: 14b07e5b-3a40-400f-8f72-ae70e8e2164e {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:08:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Instance spawned successfully.
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] No waiting events found dispatching network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:08:49 user nova-compute[74739]: WARNING nova.compute.manager [req-eb8eb3a3-f9f6-42c1-a344-64bdc79d2573 req-7a4228a8-ac8c-467d-ad65-ef3d7ce2b6d3 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received unexpected event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 for instance with vm_state building and task_state spawning.
Oct 25 18:08:49 user nova-compute[74739]: INFO nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 25 18:08:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:08:49 user nova-compute[74739]: INFO nova.compute.manager [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Took 35.05 seconds to build instance.
Oct 25 18:08:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ac335416-935b-4f53-aa0d-5cf09c6e1068 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.154s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:08:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:08:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXdlBpum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:06 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:06 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:06 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36fc5ca-1887-48b0-bc3c-54e8b18d641c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:09:06 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac451dc-6573-4642-b248-4025c21b57c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948] added
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c99fd8-8801-4c46-b3a9-9a3da7b0492f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ace019-27cc-42cd-b0f1-45150146f237]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXdlBpum {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZXdlBpum" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fdfff3-e0ae-435d-85a9-df25ab2dbc11]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZXdlBpum'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59617105-acbd-4ffc-b9af-93066ff6f3ae]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5c6cbc-bf34-409b-9357-ce2c33df4cdc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[385bb9d3-7d99-4089-832a-24a9bbde5930]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260]
Oct 25 18:09:06 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260] successful.
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c508c54c-1f5c-4643-8d7b-b1f214575097]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5950a42-c059-4a18-b40f-8427f11afcaa]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:06 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea54c5-1bf0-4ddb-8087-0b98db8f76f0]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:09:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXdlBpum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23936306532666531', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936306532666531', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:09:07 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:07 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:09:07 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:07 user nova-compute[74739]:   <serial>dcc17d5f-e29e-4444-b307-917ac431d948</serial>
Oct 25 18:09:07 user nova-compute[74739]: </disk>
Oct 25 18:09:07 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No VIF found with MAC fa:16:3e:f8:64:63, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d1933f29-3ca8-4987-a2ad-5e964d204e1d tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.307s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-changed-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG nova.compute.manager [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Refreshing instance network info cache due to event network-changed-b246d5fd-aa34-4191-bc43-600c0777db65. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] Acquiring lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] Acquired lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Refreshing network info cache for port b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updated VIF entry in instance network info cache for port b246d5fd-aa34-4191-bc43-600c0777db65. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG nova.network.neutron [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating instance_info_cache with network_info: [{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-265bfe41-734d-4e9e-b3c2-bb9ffa58f791 req-9e495a87-4727-4e74-af62-7ad75637daf3 service nova] Releasing lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:13 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:15 user nova-compute[74739]: INFO nova.compute.manager [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attaching volume 5aa4e813-1c06-49a3-afda-dcb9695e0761 to /dev/vdc
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.utils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[854ef4cd-bacf-48d0-9fbc-1e783bf9dd88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ea6dcc-8961-4f9e-b09c-4108db05cb7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b4550-b9db-4484-8264-6a489385066e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd1767-caf6-46d4-876c-a497572f8542]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:15 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:09:15 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6ce1df-93d6-47f4-b969-3fbc20117c39]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG os_brick.utils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating existing volume attachment record: 4cffafd6-584e-4988-bc08-20f353ef00fd {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:09:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:16 user nova-compute[74739]: INFO nova.compute.manager [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attaching volume 4bf8de91-4bd5-4662-945b-9d2638d379ce to /dev/vdb
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[200ebd29-57f9-4370-a976-86dcf916d814]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8a650-d548-4646-b025-bea25ee804cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cb6214-8731-4bb1-a680-292e4493c0db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ecb309-c1bc-4e46-b24f-8ca9707a2c92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:17 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d7cd1b-9758-4678-8cb9-9c9cab3c76ec]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating existing volume attachment record: 2c9cc2e2-e4db-4317-a983-56f33e7fb23d {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:09:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:09:18 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:09:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:22 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-changed-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing instance network info cache due to event network-changed-de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] Acquiring lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] Acquired lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing network info cache for port de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updated VIF entry in instance network info cache for port de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-53ba50dd-d4a9-4860-814e-5b8a7b8d85d4 req-ef8ce0eb-b36c-4949-a755-66db8bf68474 service nova] Releasing lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:09:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:24 user nova-compute[74739]: INFO nova.compute.manager [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Attaching volume 22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 to /dev/vdb
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.utils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc34d9-8ab9-4cc1-aecb-803b12bf0668]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc76b4-c228-417e-a817-32bf085c1190]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50ad4e-d399-4766-84f7-e0d3dbeba5b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf38817d-5eba-4cdf-a20e-65aef69fb85e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:09:24 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd94791-f80c-4f81-9fc1-a07807c0b27a]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG os_brick.utils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating existing volume attachment record: 3e008086-0838-4b7c-a5be-c708734ba751 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:25 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:25 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:25 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7822MB free_disk=24.978790283203125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 70725b4e-ae2c-4bc9-895c-31cb52123810 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 1a66ffb7-3634-4211-93f1-17357a1d29e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:09:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:09:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsIpTSCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:33 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:33 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:33 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5863be3c-ec23-4430-ab38-79e17de17278]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:09:33 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d254397-437f-4e28-a8cf-f9a4c934fc1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761] added
Oct 25 18:09:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6d871-2f55-4986-a9c2-9ceddcc9bda1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadea390-e065-4408-aeda-32343122c254]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsIpTSCM {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fsIpTSCM" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[027de963-9ace-4a7e-a7b2-460a507cc165]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fsIpTSCM'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479618d-4553-412f-b138-0cc921bac86e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd93185d-b647-4c24-9e31-adbe949e6483]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:33 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:33 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:33 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:33 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:33 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd0e2a3-c10b-4b18-a3c8-614ecd452e5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260]
Oct 25 18:09:34 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260] successful.
Oct 25 18:09:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d9e63e-927a-4965-8bb2-6eed4426d425]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f5f0ab-586c-4c7a-bb22-3ea1f042bd09]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2917b7-82f2-40b3-beea-fccceed91a2e]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsIpTSCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:09:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26338333037303136', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338333037303136', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:09:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:35 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:09:35 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:09:35 user nova-compute[74739]:   <serial>5aa4e813-1c06-49a3-afda-dcb9695e0761</serial>
Oct 25 18:09:35 user nova-compute[74739]: </disk>
Oct 25 18:09:35 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPgyoxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:35 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:35 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:35 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a596f972-19f8-444c-bbf3-a1075f1014e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:09:35 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[541858f3-9f79-4692-a8d0-c59d36067206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce] added
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bae5dd-ba27-4e5b-b772-32cb127f17fe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d4a55-c34f-4b83-bef4-82e38369bbac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXPgyoxt {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iXPgyoxt" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ef1bc-a220-4a12-b8f8-7773c07373f1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iXPgyoxt'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[de71fe3f-0515-481a-a573-d9c130d12be7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13cdf25-388e-4e5b-84d0-5667396c5a96]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d2d1a9-42e4-46a3-bb6b-42bc08c64930]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260]
Oct 25 18:09:35 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260] successful.
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] No VIF found with MAC fa:16:3e:f8:64:63, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2421e29-c6c6-435c-bef1-a6673f59fc67]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03ecdf2-f335-4995-b3d5-2665796968e4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:35 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:35 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3727c66-07e9-4431-8ff2-0dfa1c06b681]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPgyoxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:09:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-92323e2e-1cd9-453b-be61-406372f07095 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.587s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:36 user nova-compute[74739]: INFO nova.compute.manager [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Detaching volume dcc17d5f-e29e-4444-b307-917ac431d948
Oct 25 18:09:36 user nova-compute[74739]: INFO nova.virt.block_device [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attempting to driver detach volume dcc17d5f-e29e-4444-b307-917ac431d948 from mountpoint /dev/vdb
Oct 25 18:09:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23961313438343164', 'path': '/dev/sdf'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961313438343164', 'path': '/dev/sdf'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Attempting to detach device vdb from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:36 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:36 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:09:36 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:36 user nova-compute[74739]:   <serial>dcc17d5f-e29e-4444-b307-917ac431d948</serial>
Oct 25 18:09:36 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:09:36 user nova-compute[74739]: </disk>
Oct 25 18:09:36 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:36 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdb from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the persistent domain config.
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:36 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:36 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:09:36 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:36 user nova-compute[74739]:   <serial>dcc17d5f-e29e-4444-b307-917ac431d948</serial>
Oct 25 18:09:36 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:09:36 user nova-compute[74739]: </disk>
Oct 25 18:09:36 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:09:36 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:36 user nova-compute[74739]:   <source dev="/dev/sdf"/>
Oct 25 18:09:36 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:36 user nova-compute[74739]:   <serial>4bf8de91-4bd5-4662-945b-9d2638d379ce</serial>
Oct 25 18:09:36 user nova-compute[74739]: </disk>
Oct 25 18:09:36 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:09:37 user nova-compute[74739]: INFO nova.compute.claims [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Claim successful on node user
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No VIF found with MAC fa:16:3e:d5:12:89, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b5cb5b5d-7a74-4958-b0cb-a79215ab9400 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.313s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:09:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.policy [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0a42eef8b354d4fad0b4eb277270cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2286f0b19a436897ed0d9c42991e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:09:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Creating image(s)
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk 1073741824" returned: 0 in 0.054s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Successfully created port: 74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.217s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Cannot resize image /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Ensure instance console log exists: /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Successfully updated port: 74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-changed-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Refreshing instance network info cache due to event network-changed-74c5b044-088d-4258-808a-bc2b7199139b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] Acquiring lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] Acquired lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Refreshing network info cache for port 74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.neutron [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.neutron [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b373a239-eeaf-4f5f-8cf1-d5e6aa8994dd req-51d5443f-ef96-406a-904b-44f523f6282e service nova] Releasing lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating instance_info_cache with network_info: [{"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance network_info: |[{"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start _get_guest_xml network_info=[{"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:09:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-tempest.common.compute-instance-1860947616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'pci_devices' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:09:39 user nova-compute[74739]:   <uuid>946e1724-bc8b-4212-bc34-007e56c5e2d3</uuid>
Oct 25 18:09:39 user nova-compute[74739]:   <name>instance-00000026</name>
Oct 25 18:09:39 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:09:39 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:09:39 user nova-compute[74739]:   <metadata>
Oct 25 18:09:39 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:09:39 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:name>tempest-tempest.common.compute-instance-1860947616</nova:name>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:09:39</nova:creationTime>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:09:39 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:09:39 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:owner>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:user uuid="b0a42eef8b354d4fad0b4eb277270cb4">tempest-ServerActionsTestOtherA-1860404749-project-member</nova:user>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:project uuid="ee2286f0b19a436897ed0d9c42991e06">tempest-ServerActionsTestOtherA-1860404749</nova:project>
Oct 25 18:09:39 user nova-compute[74739]:       </nova:owner>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:09:39 user nova-compute[74739]:       <nova:ports>
Oct 25 18:09:39 user nova-compute[74739]:         <nova:port uuid="74c5b044-088d-4258-808a-bc2b7199139b">
Oct 25 18:09:39 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:09:39 user nova-compute[74739]:         </nova:port>
Oct 25 18:09:39 user nova-compute[74739]:       </nova:ports>
Oct 25 18:09:39 user nova-compute[74739]:     </nova:instance>
Oct 25 18:09:39 user nova-compute[74739]:   </metadata>
Oct 25 18:09:39 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:09:39 user nova-compute[74739]:     <system>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="serial">946e1724-bc8b-4212-bc34-007e56c5e2d3</entry>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="uuid">946e1724-bc8b-4212-bc34-007e56c5e2d3</entry>
Oct 25 18:09:39 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:09:39 user nova-compute[74739]:     </system>
Oct 25 18:09:39 user nova-compute[74739]:   </sysinfo>
Oct 25 18:09:39 user nova-compute[74739]:   <os>
Oct 25 18:09:39 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:09:39 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:09:39 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:09:39 user nova-compute[74739]:   </os>
Oct 25 18:09:39 user nova-compute[74739]:   <features>
Oct 25 18:09:39 user nova-compute[74739]:     <acpi/>
Oct 25 18:09:39 user nova-compute[74739]:     <apic/>
Oct 25 18:09:39 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:09:39 user nova-compute[74739]:   </features>
Oct 25 18:09:39 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:09:39 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:09:39 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:09:39 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:09:39 user nova-compute[74739]:   </clock>
Oct 25 18:09:39 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:09:39 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:09:39 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:09:39 user nova-compute[74739]:   </cpu>
Oct 25 18:09:39 user nova-compute[74739]:   <devices>
Oct 25 18:09:39 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:09:39 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:09:39 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk"/>
Oct 25 18:09:39 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:09:39 user nova-compute[74739]:     </disk>
Oct 25 18:09:39 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:09:39 user nova-compute[74739]:       <mac address="fa:16:3e:a8:14:fe"/>
Oct 25 18:09:39 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:09:39 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:09:39 user nova-compute[74739]:       <target dev="tap74c5b044-08"/>
Oct 25 18:09:39 user nova-compute[74739]:     </interface>
Oct 25 18:09:39 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:09:39 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/console.log" append="off"/>
Oct 25 18:09:39 user nova-compute[74739]:     </serial>
Oct 25 18:09:39 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:09:39 user nova-compute[74739]:     <video>
Oct 25 18:09:39 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:09:39 user nova-compute[74739]:     </video>
Oct 25 18:09:39 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:09:39 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:09:39 user nova-compute[74739]:     </rng>
Oct 25 18:09:39 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:09:39 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:09:39 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:09:39 user nova-compute[74739]:     </memballoon>
Oct 25 18:09:39 user nova-compute[74739]:   </devices>
Oct 25 18:09:39 user nova-compute[74739]: </domain>
Oct 25 18:09:39 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-tempest.common.compute-instance-1860947616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG os_vif [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb5b0cce-4a73-5ae8-ae1b-4455f33532cf', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74c5b044-08, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74c5b044-08, col_values=(('qos', UUID('631824fe-0b43-4d3a-9183-34b7a3658a44')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74c5b044-08, col_values=(('external_ids', {'iface-id': '74c5b044-088d-4258-808a-bc2b7199139b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:14:fe', 'vm-uuid': '946e1724-bc8b-4212-bc34-007e56c5e2d3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:39 user nova-compute[74739]: INFO os_vif [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08')
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:a8:14:fe, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:41 user nova-compute[74739]: WARNING nova.compute.manager [req-234282b0-22a4-4119-8468-4acb6f92565b req-32a10909-186b-4111-a9f8-3c948453e4f1 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state building and task_state spawning.
Oct 25 18:09:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmUbfvSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:42 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:42 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:42 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5b005-d14d-487a-91b3-dc4bc495e31b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:09:42 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[82786978-9798-4f32-b53e-63469f09336a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4] added
Oct 25 18:09:42 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f8781-53ac-48a8-8ace-cf4cac225a60]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0588b531-2583-452d-b7b7-2f3ea6ace6b1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmUbfvSK {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmUbfvSK" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1275acf-2afa-433f-bdd4-3f3e0fe9ea9b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmUbfvSK'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d424b5d6-8d27-468e-8dbc-8364593bc0dd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec8e25-a8bd-4d46-a132-dc9fc5a986fb]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d6d9f-b4dd-4f02-804f-0ce0fa44e64b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260]
Oct 25 18:09:43 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260] successful.
Oct 25 18:09:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09397264-d46d-43ef-bfdb-edec82333264]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:09:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance spawned successfully.
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f457e-073a-4ce0-8491-c1bfef106b65]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:43 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:09:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4abd5b9-752e-4143-a9f3-98265f06de7a]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmUbfvSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:09:43 user nova-compute[74739]: INFO nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:43 user nova-compute[74739]: WARNING nova.compute.manager [req-3595bf67-fc87-459e-bd7c-e53589f158c0 req-e58ea328-8b1b-4a6b-9a6c-ae55f5858a4c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state building and task_state spawning.
Oct 25 18:09:43 user nova-compute[74739]: INFO nova.compute.manager [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Took 6.34 seconds to build instance.
Oct 25 18:09:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-a0c7959f-6b22-4a83-8cdd-4698d5ecf18f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.442s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23162623135323161', 'path': '/dev/sdg'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162623135323161', 'path': '/dev/sdg'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:09:44 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:44 user nova-compute[74739]:   <source dev="/dev/sdg"/>
Oct 25 18:09:44 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:44 user nova-compute[74739]:   <serial>22d9e14f-7bdd-4a40-b2e9-5420156a6ce4</serial>
Oct 25 18:09:44 user nova-compute[74739]: </disk>
Oct 25 18:09:44 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No VIF found with MAC fa:16:3e:47:32:5e, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4182fa54-ef3b-4e07-a7ea-516aa0286001 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:47 user nova-compute[74739]: INFO nova.compute.manager [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Detaching volume 22d9e14f-7bdd-4a40-b2e9-5420156a6ce4
Oct 25 18:09:47 user nova-compute[74739]: INFO nova.virt.block_device [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Attempting to driver detach volume 22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 from mountpoint /dev/vdb
Oct 25 18:09:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Attempting to detach device vdb from instance e855c899-da17-49db-a2cd-e9166467e0fa from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:09:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:47 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:47 user nova-compute[74739]:   <source dev="/dev/sdg"/>
Oct 25 18:09:47 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:47 user nova-compute[74739]:   <serial>22d9e14f-7bdd-4a40-b2e9-5420156a6ce4</serial>
Oct 25 18:09:47 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:09:47 user nova-compute[74739]: </disk>
Oct 25 18:09:47 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully detached device vdb from instance e855c899-da17-49db-a2cd-e9166467e0fa from the persistent domain config.
Oct 25 18:09:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e855c899-da17-49db-a2cd-e9166467e0fa from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:09:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:48 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:48 user nova-compute[74739]:   <source dev="/dev/sdg"/>
Oct 25 18:09:48 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:09:48 user nova-compute[74739]:   <serial>22d9e14f-7bdd-4a40-b2e9-5420156a6ce4</serial>
Oct 25 18:09:48 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:09:48 user nova-compute[74739]: </disk>
Oct 25 18:09:48 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:09:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:56 user nova-compute[74739]: INFO nova.compute.manager [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Rescuing
Oct 25 18:09:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:09:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:09:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:09:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d is timed out.
Oct 25 18:09:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdb from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the live domain config.
Oct 25 18:09:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZXdlBpum', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:09:57 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[825474f5-4696-4ce9-aff8-4faec05f9b42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:09:57 user nova-compute[74739]: No targets found.
Oct 25 18:09:57 user nova-compute[74739]: iSNS:
Oct 25 18:09:57 user nova-compute[74739]: No targets found.
Oct 25 18:09:57 user nova-compute[74739]: STATIC:
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948
Oct 25 18:09:57 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:09:57 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:09:57 user nova-compute[74739]: FIRMWARE:
Oct 25 18:09:57 user nova-compute[74739]: No targets found.
Oct 25 18:09:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:09:57 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:09:57 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b1b584-7b6e-4bce-aa24-9f741db360dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[49075616-95fa-4713-8a43-f9d1f1481a55]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:09:57 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:09:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc3baf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ad363-1c86-4149-a427-d965752d0482]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e727ba-83da-41b1-9b60-d5e602ddb000]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3728f4b9-3cd1-4a34-8910-cfa76b7be38e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae7b57b-d12d-4c32-9dce-46ad594ee27e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ebda38-d89f-46c7-af48-6d06ad3ff206]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:57 user nova-compute[74739]: WARNING nova.compute.manager [req-b4e8305e-bb9a-4ce6-a290-fc6be9002014 req-fe04f94a-7dc6-4800-97fe-e4ae7a89885c service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c01ac4c-7c54-4570-9dec-68a747ef9972]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260]
Oct 25 18:09:57 user nova-compute[74739]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948, portal: 172.16.0.220,3260] successful.
Oct 25 18:09:57 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcc17d5f-e29e-4444-b307-917ac431d948 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa22ad-c611-4f3c-a5a3-b0ec0597abfe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== disconnect_volume: return (348ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance destroyed successfully.
Oct 25 18:09:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Attempting rescue
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 18:09:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Creating image(s)
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue" returned: 0 in 0.062s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'migration_context' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start _get_guest_xml network_info=[{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:1e:74:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'numa_topology' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:09:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1908841081',display_name='tempest-ServerRescueNegativeTestJSON-server-1908841081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1908841081',id=36,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:08:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-0c6gh0pf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:14Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:1e:74:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:1e:74:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.objects.base [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:09:58 user nova-compute[74739]:   <uuid>b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</uuid>
Oct 25 18:09:58 user nova-compute[74739]:   <name>instance-00000024</name>
Oct 25 18:09:58 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:09:58 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:09:58 user nova-compute[74739]:   <metadata>
Oct 25 18:09:58 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:09:58 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1908841081</nova:name>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:09:58</nova:creationTime>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:09:58 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:09:58 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:owner>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:09:58 user nova-compute[74739]:       </nova:owner>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:09:58 user nova-compute[74739]:       <nova:ports>
Oct 25 18:09:58 user nova-compute[74739]:         <nova:port uuid="eaf39225-a413-43c6-b9d1-04e9bf193d39">
Oct 25 18:09:58 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 25 18:09:58 user nova-compute[74739]:         </nova:port>
Oct 25 18:09:58 user nova-compute[74739]:       </nova:ports>
Oct 25 18:09:58 user nova-compute[74739]:     </nova:instance>
Oct 25 18:09:58 user nova-compute[74739]:   </metadata>
Oct 25 18:09:58 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:09:58 user nova-compute[74739]:     <system>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="serial">b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</entry>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="uuid">b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0</entry>
Oct 25 18:09:58 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:09:58 user nova-compute[74739]:     </system>
Oct 25 18:09:58 user nova-compute[74739]:   </sysinfo>
Oct 25 18:09:58 user nova-compute[74739]:   <os>
Oct 25 18:09:58 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:09:58 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:09:58 user nova-compute[74739]:   </os>
Oct 25 18:09:58 user nova-compute[74739]:   <features>
Oct 25 18:09:58 user nova-compute[74739]:     <acpi/>
Oct 25 18:09:58 user nova-compute[74739]:     <apic/>
Oct 25 18:09:58 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:09:58 user nova-compute[74739]:   </features>
Oct 25 18:09:58 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:09:58 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:09:58 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:09:58 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:09:58 user nova-compute[74739]:   </clock>
Oct 25 18:09:58 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:09:58 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:09:58 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:09:58 user nova-compute[74739]:   </cpu>
Oct 25 18:09:58 user nova-compute[74739]:   <devices>
Oct 25 18:09:58 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:09:58 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:09:58 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue"/>
Oct 25 18:09:58 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:09:58 user nova-compute[74739]:     </disk>
Oct 25 18:09:58 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:09:58 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:09:58 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk"/>
Oct 25 18:09:58 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:09:58 user nova-compute[74739]:     </disk>
Oct 25 18:09:58 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:09:58 user nova-compute[74739]:       <mac address="fa:16:3e:1e:74:68"/>
Oct 25 18:09:58 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:09:58 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:09:58 user nova-compute[74739]:       <target dev="tapeaf39225-a4"/>
Oct 25 18:09:58 user nova-compute[74739]:     </interface>
Oct 25 18:09:58 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:09:58 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/console.log" append="off"/>
Oct 25 18:09:58 user nova-compute[74739]:     </serial>
Oct 25 18:09:58 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:09:58 user nova-compute[74739]:     <video>
Oct 25 18:09:58 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:09:58 user nova-compute[74739]:     </video>
Oct 25 18:09:58 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:09:58 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:09:58 user nova-compute[74739]:     </rng>
Oct 25 18:09:58 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:09:58 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:09:58 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:09:58 user nova-compute[74739]:     </memballoon>
Oct 25 18:09:58 user nova-compute[74739]:   </devices>
Oct 25 18:09:58 user nova-compute[74739]: </domain>
Oct 25 18:09:58 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c0d389f6-f9cc-4ad1-aaa6-c26f20701616 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.044s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance destroyed successfully.
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:09:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:1e:74:68, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: INFO nova.compute.manager [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Detaching volume 5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:09:59 user nova-compute[74739]: INFO nova.virt.block_device [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Attempting to driver detach volume 5aa4e813-1c06-49a3-afda-dcb9695e0761 from mountpoint /dev/vdc
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Attempting to detach device vdc from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:59 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:59 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:09:59 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:09:59 user nova-compute[74739]:   <serial>5aa4e813-1c06-49a3-afda-dcb9695e0761</serial>
Oct 25 18:09:59 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:09:59 user nova-compute[74739]: </disk>
Oct 25 18:09:59 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdc from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the persistent domain config.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:09:59 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:09:59 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:09:59 user nova-compute[74739]:   <target dev="vdc" bus="virtio"/>
Oct 25 18:09:59 user nova-compute[74739]:   <serial>5aa4e813-1c06-49a3-afda-dcb9695e0761</serial>
Oct 25 18:09:59 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 25 18:09:59 user nova-compute[74739]: </disk>
Oct 25 18:09:59 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:59 user nova-compute[74739]: WARNING nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:59 user nova-compute[74739]: WARNING nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:59 user nova-compute[74739]: WARNING nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:59 user nova-compute[74739]: WARNING nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:09:59 user nova-compute[74739]: WARNING nova.compute.manager [req-17e3449d-e970-4ad9-aae0-80c6e710a3bf req-fdd16280-bfb3-49f9-8651-b60a21cab2ec service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:09:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:09:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:01 user nova-compute[74739]: WARNING nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:10:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:01 user nova-compute[74739]: WARNING nova.compute.manager [req-c11700c9-c21d-4889-b045-336540de9160 req-0630b649-0205-42ac-bbf8-088684d32da7 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state active and task_state rescuing.
Oct 25 18:10:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfebfa90-340c-407f-9987-f58090d65092 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.compute.manager [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing instance network info cache due to event network-changed-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] Acquiring lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] Acquired lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Refreshing network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:03 user nova-compute[74739]: INFO nova.compute.manager [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Terminating instance
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updated VIF entry in instance network info cache for port 1c4846a2-9a16-42fb-9f57-11f6d1d0f73a. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.network.neutron [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [{"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Instance destroyed successfully.
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lazy-loading 'resources' on Instance uuid 70725b4e-ae2c-4bc9-895c-31cb52123810 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:04:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-279757795',display_name='tempest-TestShelveInstance-server-279757795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-279757795',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjFjXlR1IolTdEOI29YqXzKgi2yoqhj+6JA/H/pn4xbyNlZfvY+PQ/+Qax+U36H/w7wYzWPvvOLjGoOKtXk3aL3AiIUOrAbC7hisSXQGImhKJRKQ/YXCSCPHQizMzS9Xw==',key_name='tempest-TestShelveInstance-1529691634',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:08:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e66ef0c6013c4135859334630a6cef2a',ramdisk_id='',reservation_id='r-afpnwxfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-692370709',owner_user_name='tempest-TestShelveInstance-692370709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:08:37Z,user_data=None,user_id='d6db74d902fa431fa5d589ecba46f62e',uuid=70725b4e-ae2c-4bc9-895c-31cb52123810,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converting VIF {"id": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "address": "fa:16:3e:7c:4c:5f", "network": {"id": "c1b3230e-d72e-4f00-b032-319b4d241b95", "bridge": "br-int", "label": "tempest-TestShelveInstance-2129132780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e66ef0c6013c4135859334630a6cef2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c4846a2-9a", "ovs_interfaceid": "1c4846a2-9a16-42fb-9f57-11f6d1d0f73a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG os_vif [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c4846a2-9a, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d0a0bee2-7223-4db1-99ee-bf079850ccb7 req-53ee6971-0846-441b-8eb4-346afbfca8c1 service nova] Releasing lock "refresh_cache-70725b4e-ae2c-4bc9-895c-31cb52123810" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9714b62-c6dd-4302-8527-a7d7c8209453) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:03 user nova-compute[74739]: INFO os_vif [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:4c:5f,bridge_name='br-int',has_traffic_filtering=True,id=1c4846a2-9a16-42fb-9f57-11f6d1d0f73a,network=Network(c1b3230e-d72e-4f00-b032-319b4d241b95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c4846a2-9a')
Oct 25 18:10:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gxDjkIwe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:10:03 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:10:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:10:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c10657-8a48-4388-bdfa-5680244577ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:10:04 user nova-compute[74739]: No targets found.
Oct 25 18:10:04 user nova-compute[74739]: iSNS:
Oct 25 18:10:04 user nova-compute[74739]: No targets found.
Oct 25 18:10:04 user nova-compute[74739]: STATIC:
Oct 25 18:10:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4
Oct 25 18:10:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2
Oct 25 18:10:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd
Oct 25 18:10:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:04 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:10:04 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:04 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:04 user nova-compute[74739]: FIRMWARE:
Oct 25 18:10:04 user nova-compute[74739]: No targets found.
Oct 25 18:10:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:10:04 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:10:04 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3297a3e-49c1-4eae-80d8-8601e6f4bf81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43831ac-65bd-4941-822b-9b9428c0e999]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:04 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc6d65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077652b-860a-417c-82f4-0af7d4fdcd94]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc96e7ad-98ef-4062-b8e3-6e81a3065387]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d457bf-04ef-4d2f-add4-d66ad6d688c4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.092s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff0a956-720c-4b2b-8c42-f05361b13ab7]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26464663665303266', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_583992e4', '/dev/disk/by-id/scsi-1SCST_BIO583992e4-ddf6e02f7395960f') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c833924-9374-432e-85b9-64d683f0e1af]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3f4be-27cc-45ff-af10-364569fd0fd0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f17387-b52e-4f62-9a1f-b33a71153855]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260]
Oct 25 18:10:04 user nova-compute[74739]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2, portal: 172.16.0.220,3260] successful.
Oct 25 18:10:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7edb1d67-fea4-4102-92cb-7831f1137db2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d46a44-097c-495f-ba0a-68e65523a1a1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] <== disconnect_volume: return (469ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:10:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deleting instance files /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810_del
Oct 25 18:10:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deletion of /opt/stack/data/nova/instances/70725b4e-ae2c-4bc9-895c-31cb52123810_del complete
Oct 25 18:10:04 user nova-compute[74739]: INFO nova.compute.manager [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Took 1.44 seconds to destroy the instance on the hypervisor.
Oct 25 18:10:04 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:10:04 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-unplugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Acquiring lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] No waiting events found dispatching network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:05 user nova-compute[74739]: WARNING nova.compute.manager [req-2a61d82b-3c6b-453a-b32b-20ea63ca4033 req-74a04f14-3cf1-4db7-a653-b62418565bb6 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received unexpected event network-vif-plugged-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a for instance with vm_state active and task_state deleting.
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:05 user nova-compute[74739]: INFO nova.compute.manager [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Terminating instance
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:10:05 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Took 0.62 seconds to deallocate network for instance.
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-unplugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] No waiting events found dispatching network-vif-unplugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.compute.manager [req-9257d539-5a79-45f9-a79c-c5d3902e6163 req-75b120c3-0aab-45bf-9e29-1897ccea4203 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-unplugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Instance destroyed successfully.
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid 1a66ffb7-3634-4211-93f1-17357a1d29e7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2082870404',display_name='tempest-TestVolumeBootPattern-server-2082870404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2082870404',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:08:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-h0tun5d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:08:49Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=1a66ffb7-3634-4211-93f1-17357a1d29e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "address": "fa:16:3e:6c:94:03", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcba74939-cf", "ovs_interfaceid": "cba74939-cffc-47fa-b4fe-07120fcb62b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG os_vif [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcba74939-cf, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d12bebc-7fcd-4dc1-9b5e-928aafedaef4) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:05 user nova-compute[74739]: INFO os_vif [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:94:03,bridge_name='br-int',has_traffic_filtering=True,id=cba74939-cffc-47fa-b4fe-07120fcb62b6,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcba74939-cf')
Oct 25 18:10:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dETXkNvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:10:05 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:10:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:10:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b1a047-2417-4216-9d02-f6fcee06b18d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:10:06 user nova-compute[74739]: No targets found.
Oct 25 18:10:06 user nova-compute[74739]: iSNS:
Oct 25 18:10:06 user nova-compute[74739]: No targets found.
Oct 25 18:10:06 user nova-compute[74739]: STATIC:
Oct 25 18:10:06 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4
Oct 25 18:10:06 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:06 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:06 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:06 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:06 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:06 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd
Oct 25 18:10:06 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:06 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:06 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:10:06 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:06 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:06 user nova-compute[74739]: FIRMWARE:
Oct 25 18:10:06 user nova-compute[74739]: No targets found.
Oct 25 18:10:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:10:06 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:10:06 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d0f0a-c3fb-4abd-b48d-a00766a160e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fba5e9-0c1b-4e5d-9a34-53a730151850]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:06 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc4dd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af6fc0f-37b8-4238-ad91-e86c4f0b9ff5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949ace3-ea17-4be6-a2cc-be63e242a2d2]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.compute.manager [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Took 0.96 seconds to detach 1 volumes for instance.
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Deleting volume: 7edb1d67-fea4-4102-92cb-7831f1137db2 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40bded-6521-47a0-b3f8-78729a7e5265]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e001625d-4dd5-48cd-83e4-d79ea9871639]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b3cd8e-c283-4ad6-a163-f023d50ed82e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef4a80-8703-48ea-9d0c-71d520d3fae3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260]
Oct 25 18:10:06 user nova-compute[74739]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd, portal: 172.16.0.220,3260] successful.
Oct 25 18:10:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20ad4e3c-f2fc-436f-801b-aea8c4ed19cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d6d52-a0f4-4cf8-9f95-482f79e19470]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (377ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Deleting instance files /opt/stack/data/nova/instances/1a66ffb7-3634-4211-93f1-17357a1d29e7_del
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Deletion of /opt/stack/data/nova/instances/1a66ffb7-3634-4211-93f1-17357a1d29e7_del complete
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.compute.manager [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Deleted allocations for instance 70725b4e-ae2c-4bc9-895c-31cb52123810
Oct 25 18:10:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c19da311-3b2f-4ce8-b013-141e67575605 tempest-TestShelveInstance-692370709 tempest-TestShelveInstance-692370709-project-member] Lock "70725b4e-ae2c-4bc9-895c-31cb52123810" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.629s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:06 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:06 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Took 0.43 seconds to deallocate network for instance.
Oct 25 18:10:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-4431ece2-eabe-47fa-9af6-54398763ef8d req-35360d58-77d4-4f04-bbe9-ec8a4f2d8669 service nova] [instance: 70725b4e-ae2c-4bc9-895c-31cb52123810] Received event network-vif-deleted-1c4846a2-9a16-42fb-9f57-11f6d1d0f73a {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-4431ece2-eabe-47fa-9af6-54398763ef8d req-35360d58-77d4-4f04-bbe9-ec8a4f2d8669 service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-deleted-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] Acquiring lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] No waiting events found dispatching network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:07 user nova-compute[74739]: WARNING nova.compute.manager [req-3bfcad1a-2483-4202-9d28-71e3d1de2c3e req-8a9922ba-70fa-44ee-92c1-7d2a3a3c24ae service nova] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Received unexpected event network-vif-plugged-cba74939-cffc-47fa-b4fe-07120fcb62b6 for instance with vm_state active and task_state deleting.
Oct 25 18:10:07 user nova-compute[74739]: INFO nova.compute.manager [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Took 0.92 seconds to detach 1 volumes for instance.
Oct 25 18:10:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 1a66ffb7-3634-4211-93f1-17357a1d29e7] Deleting volume: 20ad4e3c-f2fc-436f-801b-aea8c4ed19cd {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:08 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance 1a66ffb7-3634-4211-93f1-17357a1d29e7
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-84be1baf-032e-414b-8013-ac6830e6bec3 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "1a66ffb7-3634-4211-93f1-17357a1d29e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.329s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e855c899-da17-49db-a2cd-e9166467e0fa is timed out.
Oct 25 18:10:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully detached device vdb from instance e855c899-da17-49db-a2cd-e9166467e0fa from the live domain config.
Oct 25 18:10:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmUbfvSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:10:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[44af0159-0dd8-431f-b569-f5d4c2082c6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:10:08 user nova-compute[74739]: No targets found.
Oct 25 18:10:08 user nova-compute[74739]: iSNS:
Oct 25 18:10:08 user nova-compute[74739]: No targets found.
Oct 25 18:10:08 user nova-compute[74739]: STATIC:
Oct 25 18:10:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4
Oct 25 18:10:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:10:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:08 user nova-compute[74739]: FIRMWARE:
Oct 25 18:10:08 user nova-compute[74739]: No targets found.
Oct 25 18:10:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:10:08 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:10:08 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a066bcc-a243-4405-a53e-00738b7ceeb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f20bc7-c9da-4c00-956b-02b59c2ff16f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:08 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:08 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:08 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:08 user nova-compute[74739]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 (non-flash)
Oct 25 18:10:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec137e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4'): ({'sdg'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Removing single pathed devices sdg {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f07372-a049-430f-8d7c-af34c2accb37]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c8ad9-a596-4c88-97f7-4ec09326dabc]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flushing IO for device /dev/sdg {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df60b6-1593-4c1d-920a-d3db58f0d38e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[145fb109-65db-4837-ad6e-432d0791ea66]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] SCSI volumes sdg have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a750450-f147-4d49-9059-59e494767a6f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845a339-0f07-40c7-a64e-6f12d1901e28]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260]
Oct 25 18:10:08 user nova-compute[74739]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4, portal: 172.16.0.220,3260] successful.
Oct 25 18:10:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22d9e14f-7bdd-4a40-b2e9-5420156a6ce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc67feed-1d13-4d2f-bd16-763d165ec28e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== disconnect_volume: return (357ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:10:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:09 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c3c4a713-d9ba-4f3c-bc71-461f22d41b31 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.926s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:13 user nova-compute[74739]: INFO nova.compute.manager [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Detaching volume 4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:13 user nova-compute[74739]: INFO nova.virt.block_device [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attempting to driver detach volume 4bf8de91-4bd5-4662-945b-9d2638d379ce from mountpoint /dev/vdb
Oct 25 18:10:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Attempting to detach device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:10:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:10:13 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:10:13 user nova-compute[74739]:   <source dev="/dev/sdf"/>
Oct 25 18:10:13 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:10:13 user nova-compute[74739]:   <serial>4bf8de91-4bd5-4662-945b-9d2638d379ce</serial>
Oct 25 18:10:13 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:10:13 user nova-compute[74739]: </disk>
Oct 25 18:10:13 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:10:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config.
Oct 25 18:10:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:10:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:10:13 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:10:13 user nova-compute[74739]:   <source dev="/dev/sdf"/>
Oct 25 18:10:13 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:10:13 user nova-compute[74739]:   <serial>4bf8de91-4bd5-4662-945b-9d2638d379ce</serial>
Oct 25 18:10:13 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:10:13 user nova-compute[74739]: </disk>
Oct 25 18:10:13 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:10:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:10:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:10:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d is timed out.
Oct 25 18:10:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully detached device vdc from instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d from the live domain config.
Oct 25 18:10:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fsIpTSCM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:10:19 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2774c-43c1-4a63-a425-86999155eaf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:10:19 user nova-compute[74739]: No targets found.
Oct 25 18:10:19 user nova-compute[74739]: iSNS:
Oct 25 18:10:19 user nova-compute[74739]: No targets found.
Oct 25 18:10:19 user nova-compute[74739]: STATIC:
Oct 25 18:10:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761
Oct 25 18:10:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:19 user nova-compute[74739]: FIRMWARE:
Oct 25 18:10:19 user nova-compute[74739]: No targets found.
Oct 25 18:10:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:10:19 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:10:19 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:10:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f982d40-0926-426a-83e2-013d25db0eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd937f-7a2e-41ab-a0bb-174ff9951af6]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:20 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 (non-flash)
Oct 25 18:10:20 user nova-compute[74739]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52f499-847a-40e4-9ad1-ee5bc86a5807]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a15ae-db3d-4501-9b0e-f755d4b46db7]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19236ae-f286-4ae9-886e-42dfe274aafe]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[79561d2e-db14-4084-a874-7046cc4c75fb]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c3145b-a690-4946-aa02-d474c441df82]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf3b52-b7fa-4920-b02b-6a8e063b88a8]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260]
Oct 25 18:10:20 user nova-compute[74739]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761, portal: 172.16.0.220,3260] successful.
Oct 25 18:10:20 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa4e813-1c06-49a3-afda-dcb9695e0761 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8896a2-2f20-4abd-af28-21a96d54744b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] <== disconnect_volume: return (283ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:21 user nova-compute[74739]: DEBUG nova.objects.instance [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'flavor' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-64d5a3d9-7980-4405-b5c4-043c72fef492 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:22 user nova-compute[74739]: INFO nova.compute.manager [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Terminating instance
Oct 25 18:10:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-unplugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] No waiting events found dispatching network-vif-unplugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-af20433b-6134-4637-9f7b-920507ee5f88 req-62b8f199-4cad-4f11-b6b4-9118788f88dc service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-unplugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:10:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Instance destroyed successfully.
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lazy-loading 'resources' on Instance uuid dc135ee2-5e7b-44ce-aaa4-5471a49edc7d {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1304208624',display_name='tempest-AttachVolumeTestJSON-server-1304208624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1304208624',id=32,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeLJUw9QO6/nLOpawbZiv0jpoUuk67MJzU7t9Rx1+2gF7uaD68l+4g37uV9+O5gIM7LjqyC0sfbJBvPD7fP75FV8UArwVg8Rrf+N5d96k/Br0mxlROLwsQvNvM3/281+Q==',key_name='tempest-keypair-1423565967',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1631249d25ff403daae6c41e03fd040f',ramdisk_id='',reservation_id='r-drbij04a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1878388259',owner_user_name='tempest-AttachVolumeTestJSON-1878388259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73137a888d964149abda3bcac8293e01',uuid=dc135ee2-5e7b-44ce-aaa4-5471a49edc7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converting VIF {"id": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "address": "fa:16:3e:f8:64:63", "network": {"id": "ab466ba0-5c22-4285-aa41-4f5dc9949e79", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1331611153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1631249d25ff403daae6c41e03fd040f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe3ed6d3-4e", "ovs_interfaceid": "fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG os_vif [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe3ed6d3-4e, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfef3023-1152-4901-8d8d-55ed188b5b17) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:23 user nova-compute[74739]: INFO os_vif [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:64:63,bridge_name='br-int',has_traffic_filtering=True,id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1,network=Network(ab466ba0-5c22-4285-aa41-4f5dc9949e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe3ed6d3-4e')
Oct 25 18:10:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Deleting instance files /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d_del
Oct 25 18:10:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Deletion of /opt/stack/data/nova/instances/dc135ee2-5e7b-44ce-aaa4-5471a49edc7d_del complete
Oct 25 18:10:23 user nova-compute[74739]: INFO nova.compute.manager [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-6af30059-6f8b-445c-9211-fbf409d8d63e req-7dd4f5ca-3a4e-4f00-96aa-0253f3b81cbd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-deleted-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:24 user nova-compute[74739]: INFO nova.compute.manager [req-6af30059-6f8b-445c-9211-fbf409d8d63e req-7dd4f5ca-3a4e-4f00-96aa-0253f3b81cbd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Neutron deleted interface fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1; detaching it from the instance and deleting it from the info cache
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.network.neutron [req-6af30059-6f8b-445c-9211-fbf409d8d63e req-7dd4f5ca-3a4e-4f00-96aa-0253f3b81cbd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:24 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Took 0.75 seconds to deallocate network for instance.
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-6af30059-6f8b-445c-9211-fbf409d8d63e req-7dd4f5ca-3a4e-4f00-96aa-0253f3b81cbd service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Detach interface failed, port_id=fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1, reason: Instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:24 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Deleted allocations for instance dc135ee2-5e7b-44ce-aaa4-5471a49edc7d
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-104511c5-3b04-461b-b2cc-9c7762cf0e63 tempest-AttachVolumeTestJSON-1878388259 tempest-AttachVolumeTestJSON-1878388259-project-member] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] Acquiring lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] Lock "dc135ee2-5e7b-44ce-aaa4-5471a49edc7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] No waiting events found dispatching network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:10:24 user nova-compute[74739]: WARNING nova.compute.manager [req-79b5c2d5-67a0-4d58-8f68-e8168cab50c9 req-e1dee052-6910-46cd-986d-e8bbca46d97d service nova] [instance: dc135ee2-5e7b-44ce-aaa4-5471a49edc7d] Received unexpected event network-vif-plugged-fe3ed6d3-4e5f-4caa-91e3-dc4f7b06dda1 for instance with vm_state deleted and task_state None.
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:25 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid 'dc135ee2-5e7b-44ce-aaa4-5471a49edc7d' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid 'dc135ee2-5e7b-44ce-aaa4-5471a49edc7d' (instance-00000020)
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:26 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:10:26 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=24.945938110351562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:10:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:10:27 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:10:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 is timed out.
Oct 25 18:10:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config.
Oct 25 18:10:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iXPgyoxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:10:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb30cb-8905-4854-8d18-9157a3570972]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:10:34 user nova-compute[74739]: No targets found.
Oct 25 18:10:34 user nova-compute[74739]: iSNS:
Oct 25 18:10:34 user nova-compute[74739]: No targets found.
Oct 25 18:10:34 user nova-compute[74739]: STATIC:
Oct 25 18:10:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce
Oct 25 18:10:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:10:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:10:34 user nova-compute[74739]: FIRMWARE:
Oct 25 18:10:34 user nova-compute[74739]: No targets found.
Oct 25 18:10:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:10:34 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:10:34 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[318107fd-1e36-4085-9751-2af01bc3be10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad33ce7-2dae-474d-b94d-50b0c71ec10a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce (non-flash)
Oct 25 18:10:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec1c1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce'): ({'sdf'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Removing single pathed devices sdf {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2764ad44-05ff-4eec-a548-8886bce22588]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9a0a9-ef5f-4817-b227-dfee03b721f3]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flushing IO for device /dev/sdf {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12322df-7c0d-4254-82a5-2490aa9bcb7c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a549c6-541d-4e5a-bc22-fe58d8ec9124]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] SCSI volumes sdf have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9865699-88ce-4395-81de-efbd2d8687ac]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b31ee8-e973-4b87-90df-69c1fa57742b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260]
Oct 25 18:10:34 user nova-compute[74739]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce, portal: 172.16.0.220,3260] successful.
Oct 25 18:10:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bf8de91-4bd5-4662-945b-9d2638d379ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a6363b-08e1-44e6-8280-6d5c702ea080]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== disconnect_volume: return (297ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:10:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:10:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:10:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b38a91f2-a9dd-43ab-b86d-70a6bab038ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:10:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:10:48 user nova-compute[74739]: INFO nova.compute.manager [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] instance snapshotting
Oct 25 18:10:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Beginning live snapshot process
Oct 25 18:10:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json -f qcow2 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423.delta 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423.delta 1073741824" returned: 0 in 0.049s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 25 18:10:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 18:10:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] COPY block job progress, current cursor: 74776576 final cursor: 75563008 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 18:10:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74739) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 25 18:10:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 25 18:10:51 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 18:10:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423.delta /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423.delta /opt/stack/data/nova/instances/snapshots/tmp85xdma47/3c674c7986794ed3bab48bff8fb26423" returned: 0 in 0.333s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Snapshot extracted, beginning image upload
Oct 25 18:10:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:10:54 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Snapshot image upload complete
Oct 25 18:10:54 user nova-compute[74739]: INFO nova.compute.manager [None req-f8f00e05-7af1-43f2-b80f-69307d089664 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Took 5.41 seconds to snapshot the instance on the hypervisor.
Oct 25 18:10:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:10:56 user nova-compute[74739]: INFO nova.compute.claims [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Claim successful on node user
Oct 25 18:10:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:10:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:10:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.policy [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d4d5064cac7433aaf39069b94163ce0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77c27c568e254f4e91bb7bc005ecbbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:10:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Creating image(s)
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "/opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "/opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "/opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "81058356e1af6248a1d161af93a902556dda2ac3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "81058356e1af6248a1d161af93a902556dda2ac3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.part --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Successfully created port: ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.part --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG nova.virt.images [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] 8a2a73e1-acf8-4478-8b21-95480696f5b5 was qcow2, converting to raw {{(pid=74739) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG nova.privsep.utils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74739) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 25 18:10:58 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.part /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.converted {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.part /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.converted" returned: 0 in 0.566s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.converted --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "81058356e1af6248a1d161af93a902556dda2ac3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.136s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Successfully updated port: ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquired lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing instance network info cache due to event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] Acquiring lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json" returned: 0 in 0.245s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "81058356e1af6248a1d161af93a902556dda2ac3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "81058356e1af6248a1d161af93a902556dda2ac3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json" returned: 0 in 0.215s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3,backing_fmt=raw /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating instance_info_cache with network_info: [{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3,backing_fmt=raw /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk 1073741824" returned: 0 in 0.052s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "81058356e1af6248a1d161af93a902556dda2ac3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Releasing lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Instance network_info: |[{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] Acquired lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:10:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Ensure instance console log exists: /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Start _get_guest_xml network_info=[{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='2e83fcf94be798595b9d1013dbfd92da',container_format='bare',created_at=2023-10-25T18:10:49Z,direct_url=<?>,disk_format='qcow2',id=8a2a73e1-acf8-4478-8b21-95480696f5b5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1539483111',owner='77c27c568e254f4e91bb7bc005ecbbf0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T18:10:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': '8a2a73e1-acf8-4478-8b21-95480696f5b5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:11:00 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:11:00 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2e83fcf94be798595b9d1013dbfd92da',container_format='bare',created_at=2023-10-25T18:10:49Z,direct_url=<?>,disk_format='qcow2',id=8a2a73e1-acf8-4478-8b21-95480696f5b5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1539483111',owner='77c27c568e254f4e91bb7bc005ecbbf0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-25T18:10:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1430111640',display_name='tempest-TestStampPattern-server-1430111640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1430111640',id=39,image_ref='8a2a73e1-acf8-4478-8b21-95480696f5b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-zoz5qft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e855c899-da17-49db-a2cd-e9166467e0fa',image_min_disk='1',image_min_ram='0',image_owner_id='77c27c568e254f4e91bb7bc005ecbbf0',image_owner_project_name='tempest-TestStampPattern-156821719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-156821719-project-member',image_user_id='3d4d5064cac7433aaf39069b94163ce0',network_allocated='True',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:10:57Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=51662747-7171-476b-8d98-0ba4a06bc5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.objects.instance [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'pci_devices' on Instance uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:11:00 user nova-compute[74739]:   <uuid>51662747-7171-476b-8d98-0ba4a06bc5e3</uuid>
Oct 25 18:11:00 user nova-compute[74739]:   <name>instance-00000027</name>
Oct 25 18:11:00 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:11:00 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:11:00 user nova-compute[74739]:   <metadata>
Oct 25 18:11:00 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:11:00 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:name>tempest-TestStampPattern-server-1430111640</nova:name>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:11:00</nova:creationTime>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:11:00 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:11:00 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:owner>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:user uuid="3d4d5064cac7433aaf39069b94163ce0">tempest-TestStampPattern-156821719-project-member</nova:user>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:project uuid="77c27c568e254f4e91bb7bc005ecbbf0">tempest-TestStampPattern-156821719</nova:project>
Oct 25 18:11:00 user nova-compute[74739]:       </nova:owner>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:root type="image" uuid="8a2a73e1-acf8-4478-8b21-95480696f5b5"/>
Oct 25 18:11:00 user nova-compute[74739]:       <nova:ports>
Oct 25 18:11:00 user nova-compute[74739]:         <nova:port uuid="ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d">
Oct 25 18:11:00 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 18:11:00 user nova-compute[74739]:         </nova:port>
Oct 25 18:11:00 user nova-compute[74739]:       </nova:ports>
Oct 25 18:11:00 user nova-compute[74739]:     </nova:instance>
Oct 25 18:11:00 user nova-compute[74739]:   </metadata>
Oct 25 18:11:00 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:11:00 user nova-compute[74739]:     <system>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="serial">51662747-7171-476b-8d98-0ba4a06bc5e3</entry>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="uuid">51662747-7171-476b-8d98-0ba4a06bc5e3</entry>
Oct 25 18:11:00 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:11:00 user nova-compute[74739]:     </system>
Oct 25 18:11:00 user nova-compute[74739]:   </sysinfo>
Oct 25 18:11:00 user nova-compute[74739]:   <os>
Oct 25 18:11:00 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:11:00 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:11:00 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:11:00 user nova-compute[74739]:   </os>
Oct 25 18:11:00 user nova-compute[74739]:   <features>
Oct 25 18:11:00 user nova-compute[74739]:     <acpi/>
Oct 25 18:11:00 user nova-compute[74739]:     <apic/>
Oct 25 18:11:00 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:11:00 user nova-compute[74739]:   </features>
Oct 25 18:11:00 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:11:00 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:11:00 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:11:00 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:11:00 user nova-compute[74739]:   </clock>
Oct 25 18:11:00 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:11:00 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:11:00 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:11:00 user nova-compute[74739]:   </cpu>
Oct 25 18:11:00 user nova-compute[74739]:   <devices>
Oct 25 18:11:00 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:11:00 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:11:00 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk"/>
Oct 25 18:11:00 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:11:00 user nova-compute[74739]:     </disk>
Oct 25 18:11:00 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:11:00 user nova-compute[74739]:       <mac address="fa:16:3e:ed:7d:9b"/>
Oct 25 18:11:00 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:11:00 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:11:00 user nova-compute[74739]:       <target dev="tapba4b0b9b-2c"/>
Oct 25 18:11:00 user nova-compute[74739]:     </interface>
Oct 25 18:11:00 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:11:00 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/console.log" append="off"/>
Oct 25 18:11:00 user nova-compute[74739]:     </serial>
Oct 25 18:11:00 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:11:00 user nova-compute[74739]:     <video>
Oct 25 18:11:00 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:11:00 user nova-compute[74739]:     </video>
Oct 25 18:11:00 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:11:00 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:11:00 user nova-compute[74739]:     </rng>
Oct 25 18:11:00 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:11:00 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:11:00 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:11:00 user nova-compute[74739]:     </memballoon>
Oct 25 18:11:00 user nova-compute[74739]:   </devices>
Oct 25 18:11:00 user nova-compute[74739]: </domain>
Oct 25 18:11:00 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1430111640',display_name='tempest-TestStampPattern-server-1430111640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1430111640',id=39,image_ref='8a2a73e1-acf8-4478-8b21-95480696f5b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-zoz5qft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e855c899-da17-49db-a2cd-e9166467e0fa',image_min_disk='1',image_min_ram='0',image_owner_id='77c27c568e254f4e91bb7bc005ecbbf0',image_owner_project_name='tempest-TestStampPattern-156821719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-156821719-project-member',image_user_id='3d4d5064cac7433aaf39069b94163ce0',network_allocated='True',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:10:57Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=51662747-7171-476b-8d98-0ba4a06bc5e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG os_vif [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '252ddc88-0c10-5b3e-935f-678c1d34497d', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4b0b9b-2c, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4b0b9b-2c, col_values=(('qos', UUID('060d0bd0-1bf0-4eb1-83ea-bf65f4f57c2f')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4b0b9b-2c, col_values=(('external_ids', {'iface-id': 'ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:7d:9b', 'vm-uuid': '51662747-7171-476b-8d98-0ba4a06bc5e3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:00 user nova-compute[74739]: INFO os_vif [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c')
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No VIF found with MAC fa:16:3e:ed:7d:9b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updated VIF entry in instance network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG nova.network.neutron [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating instance_info_cache with network_info: [{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4d4da068-121b-4507-aa66-59aba8b42e00 req-daf7a2c4-231e-4ec7-a9e6-8cc8e80bf4e8 service nova] Releasing lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:11:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] No waiting events found dispatching network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:11:02 user nova-compute[74739]: WARNING nova.compute.manager [req-3ccea149-c638-4388-921c-54ab23b5175c req-ffb75c39-d13f-434e-a4da-62cd480500f8 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received unexpected event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d for instance with vm_state building and task_state spawning.
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:11:04 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Instance spawned successfully.
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:11:04 user nova-compute[74739]: INFO nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Took 6.92 seconds to spawn the instance on the hypervisor.
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:11:04 user nova-compute[74739]: INFO nova.compute.manager [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Took 7.80 seconds to build instance.
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] No waiting events found dispatching network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:11:04 user nova-compute[74739]: WARNING nova.compute.manager [req-7ff64e33-ab6c-401c-8efd-0f6c1f0a2951 req-bd34497f-da3e-48de-afa7-805b122ef1eb service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received unexpected event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d for instance with vm_state active and task_state None.
Oct 25 18:11:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-68d034a3-50af-4017-bc3b-74c35b8bb939 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.900s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:10 user nova-compute[74739]: INFO nova.compute.manager [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attaching volume 4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 to /dev/vdb
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.utils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc2274d-3ace-4711-9783-12c4f577bec2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e182e152-8842-4f56-8f18-ac2ad9cffca8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3778f29-4857-4004-9c47-3eb7ae0b7f41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed56337-b20e-45ce-88c8-7f46d10b7057]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:10 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:11:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf62353a-a0a6-4e54-8109-15f50a1cbb64]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG os_brick.utils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:11:10 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating existing volume attachment record: 87b1637b-5825-4480-95f0-5a3cba8e82be {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:11:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:19 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating instance_info_cache with network_info: [{"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-4a3046fd-9f36-420a-a8ca-e487df8a7db7" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:11:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:22 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:26 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:11:26 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=24.810569763183594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 51662747-7171-476b-8d98-0ba4a06bc5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:11:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-changed-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Refreshing instance network info cache due to event network-changed-74c5b044-088d-4258-808a-bc2b7199139b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] Acquiring lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] Acquired lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Refreshing network info cache for port 74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQlhfVui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:11:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:11:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:11:28 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa3863d-d9ff-4ab5-959b-f0f735c37cbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:11:28 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updated VIF entry in instance network info cache for port 74c5b044-088d-4258-808a-bc2b7199139b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating instance_info_cache with network_info: [{"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c83d3d-00d3-40f8-9978-37817594ebf9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8] added
Oct 25 18:11:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a221b9eb-523f-4e7d-a676-108939e79997 req-492f9214-396f-4cb2-adec-6d01af49f9ac service nova] Releasing lock "refresh_cache-946e1724-bc8b-4212-bc34-007e56c5e2d3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda0953-75ba-4f86-8ba0-71b0a62e1fb9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.objects.instance [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'flavor' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3e88fb-9f22-4ecb-a553-c91c08f25989]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQlhfVui {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQlhfVui" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d9beb-7aeb-4012-8860-5c8e3c3b39fb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQlhfVui'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1468bd5b-720c-48fb-8eef-e931fd40a761]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837ee59-3bdc-42de-b090-4562581c779c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:11:28 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:11:28 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:11:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:11:28 user nova-compute[74739]: 
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89de676d-de41-4fac-980f-d39eb9050d34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260]
Oct 25 18:11:28 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260] successful.
Oct 25 18:11:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd74d14-24c9-4f94-9e5b-0bc477f4a93f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64a848d-a68f-4bea-bc95-4cb3236a7dc9]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)
Oct 25 18:11:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)
Oct 25 18:11:28 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:28 user nova-compute[74739]: INFO nova.compute.manager [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attaching volume 68ac81ed-be41-4a74-947b-54c252fa3c23 to /dev/vdb
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0835e28-69b8-4e11-8fb5-dd6755529f5d]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQlhfVui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.utils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6daef95-cb1f-4812-8a75-300c2751bf2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d30ec-fee4-45b5-9147-13c08712643a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c12c9cb-4353-4e90-ab13-244d98ddbc51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[744afb68-3a91-4438-938d-8783ad775c79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:28 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:11:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[832093e7-4ae3-408d-98cd-203afb1e563c]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG os_brick.utils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:11:28 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating existing volume attachment record: 1e292f41-48ed-43c7-a007-52849dd7baaf {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23931363332323338', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931363332323338', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG nova.objects.instance [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:11:29 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:11:29 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:11:29 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:11:29 user nova-compute[74739]:   <serial>4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8</serial>
Oct 25 18:11:29 user nova-compute[74739]: </disk>
Oct 25 18:11:29 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No VIF found with MAC fa:16:3e:d5:12:89, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-29b44a29-d2dc-4df4-b4f1-c3f89917f472 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.913s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:32 user nova-compute[74739]: INFO nova.compute.manager [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Detaching volume 4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:11:32 user nova-compute[74739]: INFO nova.virt.block_device [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attempting to driver detach volume 4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 from mountpoint /dev/vdb
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Attempting to detach device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:11:32 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:11:32 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:11:32 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:11:32 user nova-compute[74739]:   <serial>4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8</serial>
Oct 25 18:11:32 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:11:32 user nova-compute[74739]: </disk>
Oct 25 18:11:32 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:11:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config.
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:11:32 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:11:32 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:11:32 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:11:32 user nova-compute[74739]:   <serial>4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8</serial>
Oct 25 18:11:32 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:11:32 user nova-compute[74739]: </disk>
Oct 25 18:11:32 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:11:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:11:32 user nova-compute[74739]: INFO nova.compute.claims [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Claim successful on node user
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:11:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.policy [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:11:33 user nova-compute[74739]: INFO nova.virt.block_device [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Booting with volume e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 at /dev/vda
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.utils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531a170-22aa-48ad-a934-16ef52d2054d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2952ea-a436-4a84-9af8-1e82e3be3c8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e0ce12-79a8-427e-88ce-0bf45860861b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcf7dd-159c-4ee7-b378-b90d3390ee3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:11:33 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:11:33 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac4115-5fbd-44a8-bd64-53d16e932a54]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG os_brick.utils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:11:33 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updating existing volume attachment record: 74762c7f-a817-432d-af1d-f957b32992ef {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Successfully created port: 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Successfully updated port: 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-changed-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Refreshing instance network info cache due to event network-changed-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:11:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] Acquiring lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updating instance_info_cache with network_info: [{"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Instance network_info: |[{"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] Acquired lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Refreshing network info cache for port 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updated VIF entry in instance network info cache for port 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updating instance_info_cache with network_info: [{"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:11:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79bac84b-f3da-42d4-877f-34d8a2080865 req-1de6ee42-68bd-4e48-8f7f-103a084d692f service nova] Releasing lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:11:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:11:53 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 is timed out.
Oct 25 18:11:53 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config.
Oct 25 18:11:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQlhfVui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:11:53 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e86436-893f-4160-bb48-966b4c52f329]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:11:53 user nova-compute[74739]: No targets found.
Oct 25 18:11:53 user nova-compute[74739]: iSNS:
Oct 25 18:11:53 user nova-compute[74739]: No targets found.
Oct 25 18:11:53 user nova-compute[74739]: STATIC:
Oct 25 18:11:53 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8
Oct 25 18:11:53 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:11:53 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:11:53 user nova-compute[74739]: FIRMWARE:
Oct 25 18:11:53 user nova-compute[74739]: No targets found.
Oct 25 18:11:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:11:53 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:11:53 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6fb547-736c-4791-a6c5-84cfb1f1509e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4bfdbf-fd1b-40c5-abcb-3c147122362a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)
Oct 25 18:11:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 (non-flash)
Oct 25 18:11:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc190550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ef57a-4c8c-40b2-8ce2-92d675717c06]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af9497-c298-4c9a-82cf-0a70d1bc5a7e]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d187b6-bbe1-46d0-bfec-bfb43d0c8563]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb19b099-afad-43f6-ad5f-e0eb87f1055f]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a1fa5a-a22c-4cfc-bf7d-77ed0dd4fd5a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea269793-cb4e-45c7-b744-de309074c9e2]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260]
Oct 25 18:11:53 user nova-compute[74739]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8, portal: 172.16.0.220,3260] successful.
Oct 25 18:11:53 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4c7f9dbe-f4b7-466b-b9c7-e98e4b43ddd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdad4eb9-5132-431a-9997-135fcc5676ad]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== disconnect_volume: return (294ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:11:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:11:54 user nova-compute[74739]: DEBUG nova.objects.instance [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:11:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-b78b34b3-0711-409f-b88c-c06c0a303163 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:11:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:03 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:03 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:03 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce395b4-99cf-440a-9c9d-b6823a05f61e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:12:03 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[47faa6f2-c1cd-496a-86b4-b1d3d140121a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23] added
Oct 25 18:12:03 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ac54c3-cf00-4346-93af-8cee32a2e2e2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00811613-22db-40f7-a3eb-0c5091104a04]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPxqzrlX {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPxqzrlX" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e98ce58-cf0a-4b1a-be35-609d7b18b19b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPxqzrlX'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d871140b-8ecb-4e83-95de-4cb32a05e372]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9d7b9-4ab1-414b-b563-47ed0271a01c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:12:03 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:12:03 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:03 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:12:03 user nova-compute[74739]: 
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0853b789-19ed-4a70-bbf9-622a19a1048d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]
Oct 25 18:12:03 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.
Oct 25 18:12:03 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5846787f-6b84-4884-a8ce-d2b00a09e047]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:12:03 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Creating image(s)
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Ensure instance console log exists: /opt/stack/data/nova/instances/76e2435b-6e67-4872-864e-3cf596c384b3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Start _get_guest_xml network_info=[{"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '74762c7f-a817-432d-af1d-f957b32992ef', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfGTDuWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '76e2435b-6e67-4872-864e-3cf596c384b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 'serial': 'e62d9b7e-fd50-4c25-bcad-ac9b8fc07423'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c27642c-1b9e-43b0-9de8-206b3d152fd4]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:03 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:03 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:03 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:03 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfGTDuWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:03 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e86d5-075f-4231-a375-b9bfc51082f4]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:12:03 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26366376463326439', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366376463326439', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.008s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:04 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:04 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG nova.objects.instance [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'flavor' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3165911-236b-4615-8b78-8897d7b82170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:12:04 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:12:04 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:04 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:12:04 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:12:04 user nova-compute[74739]:   <serial>68ac81ed-be41-4a74-947b-54c252fa3c23</serial>
Oct 25 18:12:04 user nova-compute[74739]: </disk>
Oct 25 18:12:04 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf654611-4e71-44d1-9bde-a5a6ff1840ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423] added
Oct 25 18:12:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b35ece-ac77-4586-8423-494618f66782]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665bcf6-2b2e-4276-a64d-8b23ba86b260]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfGTDuWw {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MfGTDuWw" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8801b1-8759-4dea-8b8c-2546b90eb750]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MfGTDuWw'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d08c9f-946b-498c-9b01-6383d0eab1d3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6774b1-edfe-4f33-9400-8722f9f814d0]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116ee8d-415f-4778-b6b1-efa9f81d3460]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260]
Oct 25 18:12:04 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260] successful.
Oct 25 18:12:04 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:04 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[052e715e-091e-48e7-80bf-936977095528]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be66686-8980-47e9-b5ee-6406eae04d99]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:05 user nova-compute[74739]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:05 user nova-compute[74739]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd74a3f-6bcd-49d9-b417-ad525d918680]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfGTDuWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:a8:14:fe, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cf82f1d0-47b8-40cb-a494-3aa08a5d776f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.607s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (2310ms) {'type': 'block', 'scsi_wwn': '23837386632346163', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837386632346163', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1519363626',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzqTUzLxvNqiwsVONkMCdKfSPtbB/uerUxLAdxHCtssHZiyOkTbu5o6Wj/8lBXcUDY46FX7W4uM48NAmLH72mlKyaOKjfnSH8WWsxLdEKND8nG59SMVNnALN5Xnk+ZYoA==',key_name='tempest-keypair-1351961818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-qoazju06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=76e2435b-6e67-4872-864e-3cf596c384b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid 76e2435b-6e67-4872-864e-3cf596c384b3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:12:06 user nova-compute[74739]:   <uuid>76e2435b-6e67-4872-864e-3cf596c384b3</uuid>
Oct 25 18:12:06 user nova-compute[74739]:   <name>instance-00000028</name>
Oct 25 18:12:06 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:12:06 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:12:06 user nova-compute[74739]:   <metadata>
Oct 25 18:12:06 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:12:06 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:12:06 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1519363626</nova:name>
Oct 25 18:12:06 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:12:03</nova:creationTime>
Oct 25 18:12:06 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:12:06 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:12:06 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:12:06 user nova-compute[74739]:       <nova:owner>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:12:06 user nova-compute[74739]:       </nova:owner>
Oct 25 18:12:06 user nova-compute[74739]:       <nova:ports>
Oct 25 18:12:06 user nova-compute[74739]:         <nova:port uuid="7a9ea8a4-87ed-4737-a26f-8ebb29232cc2">
Oct 25 18:12:06 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 18:12:06 user nova-compute[74739]:         </nova:port>
Oct 25 18:12:06 user nova-compute[74739]:       </nova:ports>
Oct 25 18:12:06 user nova-compute[74739]:     </nova:instance>
Oct 25 18:12:06 user nova-compute[74739]:   </metadata>
Oct 25 18:12:06 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:12:06 user nova-compute[74739]:     <system>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="serial">76e2435b-6e67-4872-864e-3cf596c384b3</entry>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="uuid">76e2435b-6e67-4872-864e-3cf596c384b3</entry>
Oct 25 18:12:06 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:12:06 user nova-compute[74739]:     </system>
Oct 25 18:12:06 user nova-compute[74739]:   </sysinfo>
Oct 25 18:12:06 user nova-compute[74739]:   <os>
Oct 25 18:12:06 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:12:06 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:12:06 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:12:06 user nova-compute[74739]:   </os>
Oct 25 18:12:06 user nova-compute[74739]:   <features>
Oct 25 18:12:06 user nova-compute[74739]:     <acpi/>
Oct 25 18:12:06 user nova-compute[74739]:     <apic/>
Oct 25 18:12:06 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:12:06 user nova-compute[74739]:   </features>
Oct 25 18:12:06 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:12:06 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:12:06 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:12:06 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:12:06 user nova-compute[74739]:   </clock>
Oct 25 18:12:06 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:12:06 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:12:06 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:12:06 user nova-compute[74739]:   </cpu>
Oct 25 18:12:06 user nova-compute[74739]:   <devices>
Oct 25 18:12:06 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:12:06 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:06 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 18:12:06 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:12:06 user nova-compute[74739]:       <serial>e62d9b7e-fd50-4c25-bcad-ac9b8fc07423</serial>
Oct 25 18:12:06 user nova-compute[74739]:     </disk>
Oct 25 18:12:06 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:12:06 user nova-compute[74739]:       <mac address="fa:16:3e:66:87:8a"/>
Oct 25 18:12:06 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:06 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:12:06 user nova-compute[74739]:       <target dev="tap7a9ea8a4-87"/>
Oct 25 18:12:06 user nova-compute[74739]:     </interface>
Oct 25 18:12:06 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:12:06 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/76e2435b-6e67-4872-864e-3cf596c384b3/console.log" append="off"/>
Oct 25 18:12:06 user nova-compute[74739]:     </serial>
Oct 25 18:12:06 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:12:06 user nova-compute[74739]:     <video>
Oct 25 18:12:06 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:06 user nova-compute[74739]:     </video>
Oct 25 18:12:06 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:12:06 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:12:06 user nova-compute[74739]:     </rng>
Oct 25 18:12:06 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:12:06 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:12:06 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:12:06 user nova-compute[74739]:     </memballoon>
Oct 25 18:12:06 user nova-compute[74739]:   </devices>
Oct 25 18:12:06 user nova-compute[74739]: </domain>
Oct 25 18:12:06 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1519363626',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzqTUzLxvNqiwsVONkMCdKfSPtbB/uerUxLAdxHCtssHZiyOkTbu5o6Wj/8lBXcUDY46FX7W4uM48NAmLH72mlKyaOKjfnSH8WWsxLdEKND8nG59SMVNnALN5Xnk+ZYoA==',key_name='tempest-keypair-1351961818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-qoazju06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=76e2435b-6e67-4872-864e-3cf596c384b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG os_vif [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ddb52ea-46b8-51d9-880e-29b7ac47b378', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9ea8a4-87, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a9ea8a4-87, col_values=(('qos', UUID('88bd6932-af65-415a-8743-cf88797d2e6a')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a9ea8a4-87, col_values=(('external_ids', {'iface-id': '7a9ea8a4-87ed-4737-a26f-8ebb29232cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:87:8a', 'vm-uuid': '76e2435b-6e67-4872-864e-3cf596c384b3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:06 user nova-compute[74739]: INFO os_vif [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87')
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:66:87:8a, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:12:07 user nova-compute[74739]: INFO nova.compute.manager [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Rebuilding instance
Oct 25 18:12:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:07 user nova-compute[74739]: WARNING nova.compute.manager [req-9048343e-c222-42c3-92a7-6de46725d1c0 req-00b3f965-1bd1-43af-b87e-fb3634496aeb service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state active and task_state rebuilding.
Oct 25 18:12:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:07 user nova-compute[74739]: DEBUG nova.compute.manager [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:07 user nova-compute[74739]: WARNING nova.compute.manager [req-4514702c-006c-482a-813e-08eb19253497 req-14b9f4ba-9662-44c1-9b88-a43e87a09aaa service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state building and task_state spawning.
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance destroyed successfully.
Oct 25 18:12:08 user nova-compute[74739]: INFO nova.compute.manager [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Detaching volume 68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:12:08 user nova-compute[74739]: INFO nova.virt.block_device [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attempting to driver detach volume 68ac81ed-be41-4a74-947b-54c252fa3c23 from mountpoint /dev/vdb
Oct 25 18:12:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Attempting to detach device vdb from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:12:08 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:08 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:12:08 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:12:08 user nova-compute[74739]:   <serial>68ac81ed-be41-4a74-947b-54c252fa3c23</serial>
Oct 25 18:12:08 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:12:08 user nova-compute[74739]: </disk>
Oct 25 18:12:08 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully detached device vdb from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the persistent domain config.
Oct 25 18:12:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[252f4adf-b898-486a-85dc-04a80749a1fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:12:08 user nova-compute[74739]: No targets found.
Oct 25 18:12:08 user nova-compute[74739]: iSNS:
Oct 25 18:12:08 user nova-compute[74739]: No targets found.
Oct 25 18:12:08 user nova-compute[74739]: STATIC:
Oct 25 18:12:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:12:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:12:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:12:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:12:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:12:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:12:08 user nova-compute[74739]: FIRMWARE:
Oct 25 18:12:08 user nova-compute[74739]: No targets found.
Oct 25 18:12:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:12:08 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:12:08 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e0c81-5755-4263-9917-1d1ccd5daa96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59dbaf-0a12-4b52-8990-2e3cb3a43d7e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:08 user nova-compute[74739]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:08 user nova-compute[74739]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec40b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea273afd-4c9a-4867-95da-288fabdac49a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20339dba-72c1-4f80-9049-c52cb805c65f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1003e4-be82-4e50-857d-47a40562aebb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9d576-5891-437c-bb5e-5ee16b8e217e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc340942-3d84-4a08-af8a-7f077c51e0c5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814ce2f-090f-4b4d-93b5-8f27518162bb]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]
Oct 25 18:12:08 user nova-compute[74739]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.
Oct 25 18:12:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfcde6e-313b-4638-b702-0335a11658e8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== disconnect_volume: return (283ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:12:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance destroyed successfully.
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-ServerActionsTestOtherA-server-541186523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:12:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74c5b044-08, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=631824fe-0b43-4d3a-9183-34b7a3658a44) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:09 user nova-compute[74739]: INFO os_vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08')
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:09 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b528f0-d5e1-4732-ae10-45fdef4880df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:12:09 user nova-compute[74739]: No targets found.
Oct 25 18:12:09 user nova-compute[74739]: iSNS:
Oct 25 18:12:09 user nova-compute[74739]: No targets found.
Oct 25 18:12:09 user nova-compute[74739]: STATIC:
Oct 25 18:12:09 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:12:09 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:12:09 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:12:09 user nova-compute[74739]: FIRMWARE:
Oct 25 18:12:09 user nova-compute[74739]: No targets found.
Oct 25 18:12:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:12:09 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:12:09 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67f732-5ca6-4351-a26f-51e15635a44c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:09 user nova-compute[74739]: WARNING nova.compute.manager [req-e89fb834-3ea5-48d8-bd9e-a1974da6d241 req-3e53f709-65fe-4f68-b87a-3162645ee06f service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state active and task_state rebuilding.
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77297533-1eb9-4a6f-bccf-994d29899dda]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:09 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec288a60>, {}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Disconnecting from: [] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== disconnect_volume: return (77ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:12:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Deleting instance files /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3_del
Oct 25 18:12:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Deletion of /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3_del complete
Oct 25 18:12:09 user nova-compute[74739]: INFO nova.virt.block_device [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Booting with volume 68ac81ed-be41-4a74-947b-54c252fa3c23 at /dev/vdb
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.utils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9c43c9-caac-48be-918c-ccf35e1ac7f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[93398ec8-b9f6-4e91-8463-04e390ba4d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5599ea4f-773d-4e34-8830-0b1ef70c649f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[36406b55-78be-40a0-81b2-d60806aa5fb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:09 user nova-compute[74739]: WARNING nova.compute.manager [req-c66c20e3-598d-40ab-8625-bad345db1d9a req-9b157269-9f51-4d80-a33a-92d4b752d77f service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state building and task_state spawning.
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:09 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:12:09 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5cea99-3ffc-4d96-afd3-424bee49e68d]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG os_brick.utils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating existing volume attachment record: b586436c-c15d-4c53-b6d6-99a400aa2fdd {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:12:09 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Instance spawned successfully.
Oct 25 18:12:09 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:10 user nova-compute[74739]: INFO nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 25 18:12:10 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:12:10 user nova-compute[74739]: INFO nova.compute.manager [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Took 37.38 seconds to build instance.
Oct 25 18:12:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9b9b6da0-c583-44c9-8b42-cd90bd3926be tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.477s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:12:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:12:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:12:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:12:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:12:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:12:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:12:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:23 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:12:27 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:27 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8177MB free_disk=24.825565338134766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 51662747-7171-476b-8d98-0ba4a06bc5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 76e2435b-6e67-4872-864e-3cf596c384b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:12:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:12:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Creating image(s)
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk 1073741824" returned: 0 in 0.051s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking if we can resize image /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Cannot resize image /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Ensure instance console log exists: /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start _get_guest_xml network_info=[{"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b586436c-c15d-4c53-b6d6-99a400aa2fdd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '946e1724-bc8b-4212-bc34-007e56c5e2d3', 'attached_at': '', 'detached_at': '', 'volume_id': '68ac81ed-be41-4a74-947b-54c252fa3c23', 'serial': '68ac81ed-be41-4a74-947b-54c252fa3c23'}, 'boot_index': None, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:12:28 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 18:12:28 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'vcpu_model' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:12:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:28 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 25 18:12:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:28 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:12:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb8f0a-aca8-4849-acbd-7ca94e6285e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:12:29 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2358767-ab8c-4c8b-945f-6bbf0e7c1324]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23] added
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64c190-9ccf-44c3-a4b8-effd8d97a98e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[080914f7-8ac6-4017-b102-4dc502fd567e]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPxqzrlX {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPxqzrlX" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df1bbd8-c751-430c-bf5f-63d97c74ce8f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPxqzrlX'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53013ac-c2cc-41aa-938e-76353e4cd062]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa699b0e-a18e-42ca-ba2b-0c430b3f5d03]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e9b011-241e-4da3-ad69-cf25ce763735]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]
Oct 25 18:12:29 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[070ad6a3-ceb8-478f-a548-1a0f7f807799]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48bf359-f859-43c3-abc0-91ad93245ebf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:29 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[99457c9b-174b-40b2-907f-0023803423a4]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:29 user nova-compute[74739]: INFO nova.compute.manager [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attaching volume 753a2bc8-7694-40c2-b79b-b8666ff0b021 to /dev/vdb
Oct 25 18:12:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.utils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb800e4e-e8c7-4fce-bb24-225f34df02f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7b5006-2c83-4141-beff-a493ff53fd01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2090b-8d80-47f6-b3aa-4adc7f44054c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2976e3-dc7c-454c-8a3d-d7b9e59a142e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:29 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:12:29 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e8decc-2957-4d43-833e-d80ef65c5f98]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG os_brick.utils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:29 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating existing volume attachment record: 9d3f6c6a-898b-4d67-b027-c6dac3da80d9 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26366376463326439', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366376463326439', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-ServerActionsTestOtherA-server-541186523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:12:30 user nova-compute[74739]:   <uuid>946e1724-bc8b-4212-bc34-007e56c5e2d3</uuid>
Oct 25 18:12:30 user nova-compute[74739]:   <name>instance-00000026</name>
Oct 25 18:12:30 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:12:30 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:12:30 user nova-compute[74739]:   <metadata>
Oct 25 18:12:30 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:12:30 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherA-server-541186523</nova:name>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:12:28</nova:creationTime>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:12:30 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:12:30 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:owner>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:user uuid="b0a42eef8b354d4fad0b4eb277270cb4">tempest-ServerActionsTestOtherA-1860404749-project-member</nova:user>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:project uuid="ee2286f0b19a436897ed0d9c42991e06">tempest-ServerActionsTestOtherA-1860404749</nova:project>
Oct 25 18:12:30 user nova-compute[74739]:       </nova:owner>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:12:30 user nova-compute[74739]:       <nova:ports>
Oct 25 18:12:30 user nova-compute[74739]:         <nova:port uuid="74c5b044-088d-4258-808a-bc2b7199139b">
Oct 25 18:12:30 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:12:30 user nova-compute[74739]:         </nova:port>
Oct 25 18:12:30 user nova-compute[74739]:       </nova:ports>
Oct 25 18:12:30 user nova-compute[74739]:     </nova:instance>
Oct 25 18:12:30 user nova-compute[74739]:   </metadata>
Oct 25 18:12:30 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:12:30 user nova-compute[74739]:     <system>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="serial">946e1724-bc8b-4212-bc34-007e56c5e2d3</entry>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="uuid">946e1724-bc8b-4212-bc34-007e56c5e2d3</entry>
Oct 25 18:12:30 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:12:30 user nova-compute[74739]:     </system>
Oct 25 18:12:30 user nova-compute[74739]:   </sysinfo>
Oct 25 18:12:30 user nova-compute[74739]:   <os>
Oct 25 18:12:30 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:12:30 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:12:30 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:12:30 user nova-compute[74739]:   </os>
Oct 25 18:12:30 user nova-compute[74739]:   <features>
Oct 25 18:12:30 user nova-compute[74739]:     <acpi/>
Oct 25 18:12:30 user nova-compute[74739]:     <apic/>
Oct 25 18:12:30 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:12:30 user nova-compute[74739]:   </features>
Oct 25 18:12:30 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:12:30 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:12:30 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:12:30 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:12:30 user nova-compute[74739]:   </clock>
Oct 25 18:12:30 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:12:30 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:12:30 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:12:30 user nova-compute[74739]:   </cpu>
Oct 25 18:12:30 user nova-compute[74739]:   <devices>
Oct 25 18:12:30 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:12:30 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:12:30 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk"/>
Oct 25 18:12:30 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:12:30 user nova-compute[74739]:     </disk>
Oct 25 18:12:30 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:12:30 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:30 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 18:12:30 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:12:30 user nova-compute[74739]:       <serial>68ac81ed-be41-4a74-947b-54c252fa3c23</serial>
Oct 25 18:12:30 user nova-compute[74739]:     </disk>
Oct 25 18:12:30 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:12:30 user nova-compute[74739]:       <mac address="fa:16:3e:a8:14:fe"/>
Oct 25 18:12:30 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:30 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:12:30 user nova-compute[74739]:       <target dev="tap74c5b044-08"/>
Oct 25 18:12:30 user nova-compute[74739]:     </interface>
Oct 25 18:12:30 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:12:30 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/console.log" append="off"/>
Oct 25 18:12:30 user nova-compute[74739]:     </serial>
Oct 25 18:12:30 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:12:30 user nova-compute[74739]:     <video>
Oct 25 18:12:30 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:30 user nova-compute[74739]:     </video>
Oct 25 18:12:30 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:12:30 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:12:30 user nova-compute[74739]:     </rng>
Oct 25 18:12:30 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:12:30 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:12:30 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:12:30 user nova-compute[74739]:     </memballoon>
Oct 25 18:12:30 user nova-compute[74739]:   </devices>
Oct 25 18:12:30 user nova-compute[74739]: </domain>
Oct 25 18:12:30 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-ServerActionsTestOtherA-server-541186523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG os_vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb5b0cce-4a73-5ae8-ae1b-4455f33532cf', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74c5b044-08, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74c5b044-08, col_values=(('qos', UUID('47450667-993c-446c-94e0-384f466c76f1')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74c5b044-08, col_values=(('external_ids', {'iface-id': '74c5b044-088d-4258-808a-bc2b7199139b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:14:fe', 'vm-uuid': '946e1724-bc8b-4212-bc34-007e56c5e2d3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:30 user nova-compute[74739]: INFO os_vif [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08')
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:a8:14:fe, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:12:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:32 user nova-compute[74739]: WARNING nova.compute.manager [req-16223ae3-a353-4223-93f5-fc5e83ecf493 req-e2483061-bd82-4e0d-aedc-73ea4594646c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state active and task_state rebuild_spawning.
Oct 25 18:12:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:12:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance spawned successfully.
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:34 user nova-compute[74739]: WARNING nova.compute.manager [req-0530fcb6-0a80-4000-ad8f-59569f3e4194 req-216be88a-4ab8-4339-ada8-85dc0e53a913 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state active and task_state rebuild_spawning.
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74739) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 25 18:12:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e88f2c7f-007f-4111-a178-16dab0b78197 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.092s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOkdsrSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:48 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:48 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:12:48 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[605ccb01-60ab-4d79-93c4-1d90f2d20e25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:12:48 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284e55d-5f77-454a-a952-348cf8cf0a18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021] added
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f473b340-10b3-4896-a6e2-9e04ecc76251]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eae12ea-1a1a-4a30-8f22-036cbe2edd41]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOkdsrSW {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOkdsrSW" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a7bd19-5126-482c-94ef-f7418f45c654]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOkdsrSW'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e56ebe-34db-4443-82d8-12eabf49edea]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[66493143-4404-4beb-8249-88de939cd139]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3955421-b4bc-4964-8791-8589bd4d5263]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260]
Oct 25 18:12:48 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260] successful.
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.240s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58035b1-241d-4af9-b5da-ddde6732add9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d28a4-644c-46b7-af30-4e42101adb70]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:12:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.548s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa4f20-d500-4dd6-8318-c8fc8fe6b6c2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOkdsrSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:12:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing instance network info cache due to event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] Acquiring lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] Acquired lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.network.neutron [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.585s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== connect_volume: return (1587ms) {'type': 'block', 'scsi_wwn': '23735623364373566', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735623364373566', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:12:49 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:49 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:12:49 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:12:49 user nova-compute[74739]:   <serial>753a2bc8-7694-40c2-b79b-b8666ff0b021</serial>
Oct 25 18:12:49 user nova-compute[74739]: </disk>
Oct 25 18:12:49 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.network.neutron [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updated VIF entry in instance network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG nova.network.neutron [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating instance_info_cache with network_info: [{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:12:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-83800dfe-b696-4762-a7dc-b2f05ddf1022 req-e4195c5c-d54d-4ea1-99e1-a28c54db4c54 service nova] Releasing lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No VIF found with MAC fa:16:3e:d5:12:89, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2a925235-3eb5-4a59-b585-9b0e4ba3c574 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.848s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG nova.objects.instance [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:51 user nova-compute[74739]: INFO nova.compute.manager [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Attaching volume 4140bfc7-5e53-40ca-9d92-76020aa7d730 to /dev/vdb
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.utils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[718d9ce2-89c2-4d72-b8d5-edc59138a713]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[924f7af5-20b7-44b1-af9b-087b0d844fa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb10e3e-2274-447e-b856-61609b973229]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bacba67-5887-438c-8367-59a0c22e661e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:12:51 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:12:51 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e73475f-39f4-4afe-9642-dbf97f6de5e9]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG os_brick.utils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:12:51 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating existing volume attachment record: e5ae875e-5cc7-4364-83ff-230d9e50dcf4 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:12:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:52 user nova-compute[74739]: INFO nova.compute.manager [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Detaching volume 753a2bc8-7694-40c2-b79b-b8666ff0b021
Oct 25 18:12:52 user nova-compute[74739]: INFO nova.virt.block_device [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attempting to driver detach volume 753a2bc8-7694-40c2-b79b-b8666ff0b021 from mountpoint /dev/vdb
Oct 25 18:12:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Attempting to detach device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:12:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:12:52 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:52 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:12:52 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:12:52 user nova-compute[74739]:   <serial>753a2bc8-7694-40c2-b79b-b8666ff0b021</serial>
Oct 25 18:12:52 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:12:52 user nova-compute[74739]: </disk>
Oct 25 18:12:52 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:12:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config.
Oct 25 18:12:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:12:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:12:52 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:12:52 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:12:52 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:12:52 user nova-compute[74739]:   <serial>753a2bc8-7694-40c2-b79b-b8666ff0b021</serial>
Oct 25 18:12:52 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:12:52 user nova-compute[74739]: </disk>
Oct 25 18:12:52 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:12:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:12:54 user nova-compute[74739]: INFO nova.compute.manager [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Rescuing
Oct 25 18:12:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:12:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:12:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:12:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:12:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG nova.compute.manager [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:55 user nova-compute[74739]: WARNING nova.compute.manager [req-0dbf8cca-dd10-4f53-af28-a8446fe9ff67 req-cb4c6d7f-70c4-43ce-88be-45a51329c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state active and task_state rescuing.
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance destroyed successfully.
Oct 25 18:12:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Attempting rescue
Oct 25 18:12:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 18:12:55 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Creating image(s)
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:55 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue" returned: 0 in 0.054s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'migration_context' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.base [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<5eea09f6-2a67-47d3-ba47-356a73a68b67> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start _get_guest_xml network_info=[{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:77:40:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.base [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<5eea09f6-2a67-47d3-ba47-356a73a68b67> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'numa_topology' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.base [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<5eea09f6-2a67-47d3-ba47-356a73a68b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:12:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.base [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<5eea09f6-2a67-47d3-ba47-356a73a68b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416959544',display_name='tempest-ServerRescueNegativeTestJSON-server-1416959544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416959544',id=35,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:08:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-qk44zhze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:08:14Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=5eea09f6-2a67-47d3-ba47-356a73a68b67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:77:40:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:77:40:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.objects.base [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<5eea09f6-2a67-47d3-ba47-356a73a68b67> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:12:56 user nova-compute[74739]:   <uuid>5eea09f6-2a67-47d3-ba47-356a73a68b67</uuid>
Oct 25 18:12:56 user nova-compute[74739]:   <name>instance-00000023</name>
Oct 25 18:12:56 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:12:56 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:12:56 user nova-compute[74739]:   <metadata>
Oct 25 18:12:56 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:12:56 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1416959544</nova:name>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:12:56</nova:creationTime>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:12:56 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:12:56 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:owner>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:12:56 user nova-compute[74739]:       </nova:owner>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:12:56 user nova-compute[74739]:       <nova:ports>
Oct 25 18:12:56 user nova-compute[74739]:         <nova:port uuid="7ff5936a-a844-4cc9-abb9-f0e591e57e23">
Oct 25 18:12:56 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 18:12:56 user nova-compute[74739]:         </nova:port>
Oct 25 18:12:56 user nova-compute[74739]:       </nova:ports>
Oct 25 18:12:56 user nova-compute[74739]:     </nova:instance>
Oct 25 18:12:56 user nova-compute[74739]:   </metadata>
Oct 25 18:12:56 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:12:56 user nova-compute[74739]:     <system>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="serial">5eea09f6-2a67-47d3-ba47-356a73a68b67</entry>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="uuid">5eea09f6-2a67-47d3-ba47-356a73a68b67</entry>
Oct 25 18:12:56 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:12:56 user nova-compute[74739]:     </system>
Oct 25 18:12:56 user nova-compute[74739]:   </sysinfo>
Oct 25 18:12:56 user nova-compute[74739]:   <os>
Oct 25 18:12:56 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:12:56 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:12:56 user nova-compute[74739]:   </os>
Oct 25 18:12:56 user nova-compute[74739]:   <features>
Oct 25 18:12:56 user nova-compute[74739]:     <acpi/>
Oct 25 18:12:56 user nova-compute[74739]:     <apic/>
Oct 25 18:12:56 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:12:56 user nova-compute[74739]:   </features>
Oct 25 18:12:56 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:12:56 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:12:56 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:12:56 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:12:56 user nova-compute[74739]:   </clock>
Oct 25 18:12:56 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:12:56 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:12:56 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:12:56 user nova-compute[74739]:   </cpu>
Oct 25 18:12:56 user nova-compute[74739]:   <devices>
Oct 25 18:12:56 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:12:56 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:12:56 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue"/>
Oct 25 18:12:56 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:12:56 user nova-compute[74739]:     </disk>
Oct 25 18:12:56 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:12:56 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:12:56 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk"/>
Oct 25 18:12:56 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:12:56 user nova-compute[74739]:     </disk>
Oct 25 18:12:56 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:12:56 user nova-compute[74739]:       <mac address="fa:16:3e:77:40:01"/>
Oct 25 18:12:56 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:56 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:12:56 user nova-compute[74739]:       <target dev="tap7ff5936a-a8"/>
Oct 25 18:12:56 user nova-compute[74739]:     </interface>
Oct 25 18:12:56 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:12:56 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/console.log" append="off"/>
Oct 25 18:12:56 user nova-compute[74739]:     </serial>
Oct 25 18:12:56 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:12:56 user nova-compute[74739]:     <video>
Oct 25 18:12:56 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:12:56 user nova-compute[74739]:     </video>
Oct 25 18:12:56 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:12:56 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:12:56 user nova-compute[74739]:     </rng>
Oct 25 18:12:56 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:12:56 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:12:56 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:12:56 user nova-compute[74739]:     </memballoon>
Oct 25 18:12:56 user nova-compute[74739]:   </devices>
Oct 25 18:12:56 user nova-compute[74739]: </domain>
Oct 25 18:12:56 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:12:56 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance destroyed successfully.
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:12:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:77:40:01, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG nova.compute.manager [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:57 user nova-compute[74739]: WARNING nova.compute.manager [req-3dacb742-cae2-428c-8674-767916380500 req-b774e275-9cae-4fb0-9074-c64493c2f89f service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state active and task_state rescuing.
Oct 25 18:12:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:59 user nova-compute[74739]: WARNING nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state active and task_state rescuing.
Oct 25 18:12:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:12:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:12:59 user nova-compute[74739]: WARNING nova.compute.manager [req-86ec99b4-4271-4b54-8820-59102fcd4328 req-61530f3f-9289-4fd9-b251-9d9b5b8209b8 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state active and task_state rescuing.
Oct 25 18:12:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1d0cc320-dfdf-4508-a673-0d2fb57ddcc9 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:13:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTwaRiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:13:10 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:13:10 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:13:10 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6ace09-a4d6-4ab3-851a-bf86f7f25aa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:13:10 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd5fe64-2d16-4720-8a4c-218b13c6a002]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730] added
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa46e5d-f96b-4ad8-a56e-67dbf9027a87]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca30aa3-a85c-4af2-af0f-2db5a06b4657]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTwaRiz {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gfTwaRiz" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd75c458-4e6e-4dc1-b9b9-a741cc55b600]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gfTwaRiz'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ec599-fa30-4d9c-b2ca-1703f2021e10]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68cc91a-ee4b-43e9-9311-fbaf79a33365]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1d67a6-c77d-45f4-9402-1182b5929fdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260]
Oct 25 18:13:10 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260] successful.
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79bfa21-8b3b-4c1d-85fe-349675d0daf2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0995dbae-a6d6-4a62-9f80-ff6bb34c19f7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:10 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa25807e-382c-441f-a9df-fe1ed1140cb5]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:13:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTwaRiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23665383436316537', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665383436316537', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.objects.instance [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:13:11 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:13:11 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:13:11 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:13:11 user nova-compute[74739]:   <serial>4140bfc7-5e53-40ca-9d92-76020aa7d730</serial>
Oct 25 18:13:11 user nova-compute[74739]: </disk>
Oct 25 18:13:11 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:13:11 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] No VIF found with MAC fa:16:3e:ed:7d:9b, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:13:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-86d7fd48-4891-4dde-8439-c0b2de596657 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.931s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:13 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 is timed out.
Oct 25 18:13:13 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config.
Oct 25 18:13:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOkdsrSW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:13:13 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[734bbd6c-a18a-4855-8482-9234464849c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:13:13 user nova-compute[74739]: No targets found.
Oct 25 18:13:13 user nova-compute[74739]: iSNS:
Oct 25 18:13:13 user nova-compute[74739]: No targets found.
Oct 25 18:13:13 user nova-compute[74739]: STATIC:
Oct 25 18:13:13 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730
Oct 25 18:13:13 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:13 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:13 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021
Oct 25 18:13:13 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:13 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:13 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:13:13 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:13 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:13 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:13:13 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:13 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:13 user nova-compute[74739]: FIRMWARE:
Oct 25 18:13:13 user nova-compute[74739]: No targets found.
Oct 25 18:13:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:13:13 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:13:13 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb13c01a-8264-4a17-a655-f96908064c39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00737ea2-fe78-407a-8019-91ee3de055d0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc2453f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b259ddb-8848-48b8-bfae-b14d5cec6e32]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0fdbc6-ced0-4178-ab71-d51297c9ae0f]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c32ebd-ec4a-47f2-b81a-fe3b9f9dc5e7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5682b008-9bbc-4531-bd8d-600fd12614c1]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d2a981-4eb6-4166-90d0-7ddb6afac156]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67b2772-8137-4f38-9847-74a7f5e67e08]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260]
Oct 25 18:13:13 user nova-compute[74739]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021, portal: 172.16.0.220,3260] successful.
Oct 25 18:13:13 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753a2bc8-7694-40c2-b79b-b8666ff0b021 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32da1b-5ca6-4cec-912b-0217bdda724a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== disconnect_volume: return (363ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:13:13 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:14 user nova-compute[74739]: INFO nova.compute.manager [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Detaching volume 4140bfc7-5e53-40ca-9d92-76020aa7d730
Oct 25 18:13:14 user nova-compute[74739]: INFO nova.virt.block_device [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Attempting to driver detach volume 4140bfc7-5e53-40ca-9d92-76020aa7d730 from mountpoint /dev/vdb
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Attempting to detach device vdb from instance 51662747-7171-476b-8d98-0ba4a06bc5e3 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:13:14 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:13:14 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:13:14 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:13:14 user nova-compute[74739]:   <serial>4140bfc7-5e53-40ca-9d92-76020aa7d730</serial>
Oct 25 18:13:14 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:13:14 user nova-compute[74739]: </disk>
Oct 25 18:13:14 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:13:14 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully detached device vdb from instance 51662747-7171-476b-8d98-0ba4a06bc5e3 from the persistent domain config.
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51662747-7171-476b-8d98-0ba4a06bc5e3 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:13:14 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:13:14 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:13:14 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:13:14 user nova-compute[74739]:   <serial>4140bfc7-5e53-40ca-9d92-76020aa7d730</serial>
Oct 25 18:13:14 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:13:14 user nova-compute[74739]: </disk>
Oct 25 18:13:14 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.objects.instance [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:13:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-6b0460c8-67f2-4e9c-b43e-0c82f65e622e tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.941s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:13:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 76e2435b-6e67-4872-864e-3cf596c384b3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:13:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:13:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:13:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:13:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:13:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-changed-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Refreshing instance network info cache due to event network-changed-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] Acquiring lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] Acquired lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:13:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Refreshing network info cache for port 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG nova.network.neutron [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updated VIF entry in instance network info cache for port 7a9ea8a4-87ed-4737-a26f-8ebb29232cc2. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG nova.network.neutron [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updating instance_info_cache with network_info: [{"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b215d4fc-875c-4224-9754-230acbc00198 req-79b384d7-877a-4dc5-b000-64f6672fffb3 service nova] Releasing lock "refresh_cache-76e2435b-6e67-4872-864e-3cf596c384b3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:25 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:13:27 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:13:27 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:13:27 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=24.785533905029297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 51662747-7171-476b-8d98-0ba4a06bc5e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 76e2435b-6e67-4872-864e-3cf596c384b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.962s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:13:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 4 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:13:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Deletion of /opt/stack/data/nova/instances/7926c5ce-2435-4493-813f-4dca6e1f204f_resize failed
Oct 25 18:13:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51662747-7171-476b-8d98-0ba4a06bc5e3 is timed out.
Oct 25 18:13:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully detached device vdb from instance 51662747-7171-476b-8d98-0ba4a06bc5e3 from the live domain config.
Oct 25 18:13:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gfTwaRiz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:13:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242d1d9-8814-45a8-9c0f-5ecbc0e2734c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:13:34 user nova-compute[74739]: No targets found.
Oct 25 18:13:34 user nova-compute[74739]: iSNS:
Oct 25 18:13:34 user nova-compute[74739]: No targets found.
Oct 25 18:13:34 user nova-compute[74739]: STATIC:
Oct 25 18:13:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730
Oct 25 18:13:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:13:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:13:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:13:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:13:34 user nova-compute[74739]: FIRMWARE:
Oct 25 18:13:34 user nova-compute[74739]: No targets found.
Oct 25 18:13:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:13:34 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:13:34 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3302c10d-44b1-45ec-a560-d9e2322d5862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7f054-fb11-490d-a0e6-5d1b8863323c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 (non-flash)
Oct 25 18:13:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc32c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab0212-4add-493f-a4ac-100cba74b0d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb20fcb1-7a6a-4f98-8760-33a6de100460]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37ffdca-4a0d-4c35-8f5e-9fbea526d915]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[67951899-10a8-4a70-9f4f-119d7ebeebe1]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c3cce-8698-45d7-8b45-862c2d49219d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3d676-ff90-43e9-b313-be123f87061d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260]
Oct 25 18:13:34 user nova-compute[74739]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730, portal: 172.16.0.220,3260] successful.
Oct 25 18:13:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4140bfc7-5e53-40ca-9d92-76020aa7d730 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b132d5-1942-48a7-b021-225f47049e77]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] <== disconnect_volume: return (333ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'flavor' on Instance uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-7911f5b7-724a-4816-923b-8bfdc51b09a4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.945s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:13:37 user nova-compute[74739]: INFO nova.compute.claims [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Claim successful on node user
Oct 25 18:13:37 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:13:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:13:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:13:38 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:13:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:13:38 user nova-compute[74739]: INFO nova.virt.block_device [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Booting with volume snapshot b2f4a770-6282-4854-ba51-3ca202060aaf at /dev/vda
Oct 25 18:13:38 user nova-compute[74739]: DEBUG nova.policy [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:13:38 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Successfully created port: 7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Successfully updated port: 7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-changed-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.compute.manager [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Refreshing instance network info cache due to event network-changed-7af5b297-e9fb-451a-874e-b3e680fd76de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] Acquiring lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updating instance_info_cache with network_info: [{"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Instance network_info: |[{"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] Acquired lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Refreshing network info cache for port 7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:13:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:13:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updated VIF entry in instance network info cache for port 7af5b297-e9fb-451a-874e-b3e680fd76de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:13:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updating instance_info_cache with network_info: [{"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:13:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bc5ccf3c-22d1-4906-87ad-f73deea76408 req-92fccfa9-fabb-4b16-8f14-2007f5d7ac54 service nova] Releasing lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:13:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG os_brick.utils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8f360-8467-491c-9831-a5a25bd0c131]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[15132159-4b66-4f85-b0b7-58e32be4d0c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77e5adf-3649-4df2-a487-8763c33787aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c5273-c5f9-4781-a65c-6eaf1539ecdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:13:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:13:44 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:13:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd97c08-2bf7-43ac-80b4-ee2f8305e884]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG os_brick.utils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:13:44 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updating existing volume attachment record: c0cb172a-ee22-473e-99e9-749805e2a9f6 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:13:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:47 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:13:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:13:48 user nova-compute[74739]: INFO nova.compute.manager [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attaching volume da287983-ebf1-428a-ab74-560f18ce5401 to /dev/vdb
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc6adc-4767-4c0f-b57f-8d03560c14b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee02ef-60ca-4ceb-879c-3533657ea81e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880e7e8-3331-43e8-86f0-d3618dbc7b32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8114e3-09d9-49f0-b6e9-4431726e32dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:13:48 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:13:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[244de813-8087-45e8-aeff-c8d7e7e7ac1e]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG os_brick.utils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:13:48 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating existing volume attachment record: f05b5b61-28eb-4ce1-9f6b-1f456002893b {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:13:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:14:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Creating image(s)
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Ensure instance console log exists: /opt/stack/data/nova/instances/b5a734b0-ef37-4c03-806a-a0ca96985742/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Start _get_guest_xml network_info=[{"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T18:13:25Z,direct_url=<?>,disk_format='qcow2',id=e478d4a6-f1bc-4206-9a78-a34b8782ae81,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2093635050',owner='6bfa536399c34f8d8321bf6f69ef0cd6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T18:13:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'c0cb172a-ee22-473e-99e9-749805e2a9f6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVxpTbIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b5a734b0-ef37-4c03-806a-a0ca96985742', 'attached_at': '', 'detached_at': '', 'volume_id': '2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 'serial': '2ab43ff1-4ccb-405b-85de-1b88c63bacc4'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:14:01 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:14:01 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-25T18:13:25Z,direct_url=<?>,disk_format='qcow2',id=e478d4a6-f1bc-4206-9a78-a34b8782ae81,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2093635050',owner='6bfa536399c34f8d8321bf6f69ef0cd6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-25T18:13:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVxpTbIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:14:01 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:14:01 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:14:01 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93d486-270b-4cb2-904a-e3b3c36e3841]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:14:01 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[28345828-733e-49ef-8009-b1790b43494e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4] added
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c2a81f-9c56-43df-a067-8df0029076b4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[075c2f71-263b-473b-a270-dca9e85bf2a8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVxpTbIH {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tVxpTbIH" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf817388-4834-4029-92dc-e9c457ce8123]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tVxpTbIH'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[86084e4f-e05f-49c2-8c0d-b770508c13df]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6735f1-e647-4d69-ab84-7213278cf2cc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb90e084-44b3-4fd6-b6bd-f6f76a0c2148]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260]
Oct 25 18:14:01 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260] successful.
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e48ceb-278a-47b9-9f57-1256b38f8907]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b801d3c-86be-4a5e-afcc-18635d9961a3]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:01 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25dd6e-5e7c-4aaa-b9dc-f5637fd8fe8e]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:14:01 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVxpTbIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26136343762393132', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136343762393132', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-954113151',id=41,image_ref='e478d4a6-f1bc-4206-9a78-a34b8782ae81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKEqd2NKM471T/LtcHtHkxXaJt8JO43Fvk2AZDV45jjQ6bXUUvrrLf4WXqZEog3z+uvgg/Wg84xkmwxuXjq2UADXwRAIQsBwEmKb6WQtm543s1OiXwWML2+CwmX4JHj+g==',key_name='tempest-keypair-1623404985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-bn5fxuyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2117961967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=b5a734b0-ef37-4c03-806a-a0ca96985742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid b5a734b0-ef37-4c03-806a-a0ca96985742 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:14:02 user nova-compute[74739]:   <uuid>b5a734b0-ef37-4c03-806a-a0ca96985742</uuid>
Oct 25 18:14:02 user nova-compute[74739]:   <name>instance-00000029</name>
Oct 25 18:14:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:14:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:14:02 user nova-compute[74739]:   <metadata>
Oct 25 18:14:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:14:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-954113151</nova:name>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:14:01</nova:creationTime>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:14:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:14:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:owner>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:14:02 user nova-compute[74739]:       </nova:owner>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:root type="image" uuid="e478d4a6-f1bc-4206-9a78-a34b8782ae81"/>
Oct 25 18:14:02 user nova-compute[74739]:       <nova:ports>
Oct 25 18:14:02 user nova-compute[74739]:         <nova:port uuid="7af5b297-e9fb-451a-874e-b3e680fd76de">
Oct 25 18:14:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 18:14:02 user nova-compute[74739]:         </nova:port>
Oct 25 18:14:02 user nova-compute[74739]:       </nova:ports>
Oct 25 18:14:02 user nova-compute[74739]:     </nova:instance>
Oct 25 18:14:02 user nova-compute[74739]:   </metadata>
Oct 25 18:14:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:14:02 user nova-compute[74739]:     <system>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="serial">b5a734b0-ef37-4c03-806a-a0ca96985742</entry>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="uuid">b5a734b0-ef37-4c03-806a-a0ca96985742</entry>
Oct 25 18:14:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:14:02 user nova-compute[74739]:     </system>
Oct 25 18:14:02 user nova-compute[74739]:   </sysinfo>
Oct 25 18:14:02 user nova-compute[74739]:   <os>
Oct 25 18:14:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:14:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:14:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:14:02 user nova-compute[74739]:   </os>
Oct 25 18:14:02 user nova-compute[74739]:   <features>
Oct 25 18:14:02 user nova-compute[74739]:     <acpi/>
Oct 25 18:14:02 user nova-compute[74739]:     <apic/>
Oct 25 18:14:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:14:02 user nova-compute[74739]:   </features>
Oct 25 18:14:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:14:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:14:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:14:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:14:02 user nova-compute[74739]:   </clock>
Oct 25 18:14:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:14:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:14:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:14:02 user nova-compute[74739]:   </cpu>
Oct 25 18:14:02 user nova-compute[74739]:   <devices>
Oct 25 18:14:02 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:14:02 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:02 user nova-compute[74739]:       <source dev="/dev/sdd"/>
Oct 25 18:14:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:14:02 user nova-compute[74739]:       <serial>2ab43ff1-4ccb-405b-85de-1b88c63bacc4</serial>
Oct 25 18:14:02 user nova-compute[74739]:     </disk>
Oct 25 18:14:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:14:02 user nova-compute[74739]:       <mac address="fa:16:3e:09:82:54"/>
Oct 25 18:14:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:14:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:14:02 user nova-compute[74739]:       <target dev="tap7af5b297-e9"/>
Oct 25 18:14:02 user nova-compute[74739]:     </interface>
Oct 25 18:14:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:14:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b5a734b0-ef37-4c03-806a-a0ca96985742/console.log" append="off"/>
Oct 25 18:14:02 user nova-compute[74739]:     </serial>
Oct 25 18:14:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:14:02 user nova-compute[74739]:     <video>
Oct 25 18:14:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:14:02 user nova-compute[74739]:     </video>
Oct 25 18:14:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:14:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:14:02 user nova-compute[74739]:     </rng>
Oct 25 18:14:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:14:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:14:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:14:02 user nova-compute[74739]:     </memballoon>
Oct 25 18:14:02 user nova-compute[74739]:   </devices>
Oct 25 18:14:02 user nova-compute[74739]: </domain>
Oct 25 18:14:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-954113151',id=41,image_ref='e478d4a6-f1bc-4206-9a78-a34b8782ae81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKEqd2NKM471T/LtcHtHkxXaJt8JO43Fvk2AZDV45jjQ6bXUUvrrLf4WXqZEog3z+uvgg/Wg84xkmwxuXjq2UADXwRAIQsBwEmKb6WQtm543s1OiXwWML2+CwmX4JHj+g==',key_name='tempest-keypair-1623404985',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-bn5fxuyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2117961967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:13:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=b5a734b0-ef37-4c03-806a-a0ca96985742,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG os_vif [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76ef447c-39bb-5ddd-9811-78b7c95a4532', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7af5b297-e9, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7af5b297-e9, col_values=(('qos', UUID('c360d003-c67a-48ad-b426-0522b11a5baf')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7af5b297-e9, col_values=(('external_ids', {'iface-id': '7af5b297-e9fb-451a-874e-b3e680fd76de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:82:54', 'vm-uuid': 'b5a734b0-ef37-4c03-806a-a0ca96985742'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:02 user nova-compute[74739]: INFO os_vif [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9')
Oct 25 18:14:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:14:03 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:09:82:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] No waiting events found dispatching network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:04 user nova-compute[74739]: WARNING nova.compute.manager [req-571f8dcf-98ab-4946-8e45-fe409a0af7e8 req-0066eb9e-2796-4168-a64d-60f71b1ec3af service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received unexpected event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de for instance with vm_state building and task_state spawning.
Oct 25 18:14:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing instance network info cache due to event network-changed-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] Acquiring lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] Acquired lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.network.neutron [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Refreshing network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:04 user nova-compute[74739]: INFO nova.compute.manager [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Terminating instance
Oct 25 18:14:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updated VIF entry in instance network info cache for port ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.network.neutron [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating instance_info_cache with network_info: [{"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cfcd13cb-ccf9-4ad1-a97f-967fc55f77b1 req-d73496a9-804f-4f9a-b880-7251bd323433 service nova] Releasing lock "refresh_cache-51662747-7171-476b-8d98-0ba4a06bc5e3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Instance destroyed successfully.
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'resources' on Instance uuid 51662747-7171-476b-8d98-0ba4a06bc5e3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1430111640',display_name='tempest-TestStampPattern-server-1430111640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1430111640',id=39,image_ref='8a2a73e1-acf8-4478-8b21-95480696f5b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-zoz5qft6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e855c899-da17-49db-a2cd-e9166467e0fa',image_min_disk='1',image_min_ram='0',image_owner_id='77c27c568e254f4e91bb7bc005ecbbf0',image_owner_project_name='tempest-TestStampPattern-156821719',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-156821719-project-member',image_user_id='3d4d5064cac7433aaf39069b94163ce0',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:11:04Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=51662747-7171-476b-8d98-0ba4a06bc5e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "address": "fa:16:3e:ed:7d:9b", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4b0b9b-2c", "ovs_interfaceid": "ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_vif [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4b0b9b-2c, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=060d0bd0-1bf0-4eb1-83ea-bf65f4f57c2f) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:05 user nova-compute[74739]: INFO os_vif [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:7d:9b,bridge_name='br-int',has_traffic_filtering=True,id=ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4b0b9b-2c')
Oct 25 18:14:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Deleting instance files /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3_del
Oct 25 18:14:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Deletion of /opt/stack/data/nova/instances/51662747-7171-476b-8d98-0ba4a06bc5e3_del complete
Oct 25 18:14:05 user nova-compute[74739]: INFO nova.compute.manager [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtxRfNsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:14:05 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:14:05 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:14:05 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e079b99-ef52-4947-937d-87a657c6bc4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:14:05 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f8764-1e89-4d04-a0ff-1c4ffb462182]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401] added
Oct 25 18:14:05 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6684a44-dc25-42dd-8c1a-cdcfa688cd67]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6fa4ac-542a-45bc-991c-428a4e8ec4d1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtxRfNsP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtxRfNsP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b92540-e045-48e4-aebf-a51668b5b644]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtxRfNsP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[061cabac-c5df-4652-ac58-ac3e4e441253]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:05 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff95587-a243-43b0-a0c0-b3571cfccb14]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bff873-b0f1-42e9-9020-6962c3a41b04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260]
Oct 25 18:14:06 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260] successful.
Oct 25 18:14:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c582ceb-6fcc-43f4-b0de-58e3be73272f]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[48686d72-27c4-4448-a04e-2b3d024ca3e5]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)
Oct 25 18:14:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cbe343-956c-4580-ade5-170df84109b2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtxRfNsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:14:06 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Took 0.43 seconds to deallocate network for instance.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:14:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Instance spawned successfully.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] No waiting events found dispatching network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:06 user nova-compute[74739]: WARNING nova.compute.manager [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received unexpected event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de for instance with vm_state building and task_state spawning.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-1200b190-94e7-4ba2-9b33-e57185d6862f req-b8219b87-df82-429a-9851-cc167e51c677 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-vif-deleted-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:06 user nova-compute[74739]: INFO nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Took 5.05 seconds to spawn the instance on the hypervisor.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:14:06 user nova-compute[74739]: INFO nova.compute.manager [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Took 29.00 seconds to build instance.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-9ce0993c-f803-4679-b10f-3b43fa87eea2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.096s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Deleted allocations for instance 51662747-7171-476b-8d98-0ba4a06bc5e3
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e33beba6-a73d-43da-a495-b14363b712f4 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-vif-unplugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] No waiting events found dispatching network-vif-unplugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:06 user nova-compute[74739]: WARNING nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received unexpected event network-vif-unplugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d for instance with vm_state deleted and task_state None.
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Acquiring lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] Lock "51662747-7171-476b-8d98-0ba4a06bc5e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:06 user nova-compute[74739]: DEBUG nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] No waiting events found dispatching network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:06 user nova-compute[74739]: WARNING nova.compute.manager [req-133e50e1-2206-4955-9dee-d5aa9354f834 req-b65b26b3-8fbb-4752-bf62-b258e44ad676 service nova] [instance: 51662747-7171-476b-8d98-0ba4a06bc5e3] Received unexpected event network-vif-plugged-ba4b0b9b-2c64-45d3-b66d-8de2c917bf8d for instance with vm_state deleted and task_state None.
Oct 25 18:14:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26265333061336434', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265333061336434', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:14:07 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:07 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:14:07 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:14:07 user nova-compute[74739]:   <serial>da287983-ebf1-428a-ab74-560f18ce5401</serial>
Oct 25 18:14:07 user nova-compute[74739]: </disk>
Oct 25 18:14:07 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] No VIF found with MAC fa:16:3e:d5:12:89, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:14:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-4ead31db-00eb-4ec4-b2d7-33a404c44176 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.729s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:10 user nova-compute[74739]: INFO nova.compute.manager [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Detaching volume da287983-ebf1-428a-ab74-560f18ce5401
Oct 25 18:14:10 user nova-compute[74739]: INFO nova.virt.block_device [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Attempting to driver detach volume da287983-ebf1-428a-ab74-560f18ce5401 from mountpoint /dev/vdb
Oct 25 18:14:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Attempting to detach device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:14:10 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:10 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:14:10 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:14:10 user nova-compute[74739]:   <serial>da287983-ebf1-428a-ab74-560f18ce5401</serial>
Oct 25 18:14:10 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:14:10 user nova-compute[74739]: </disk>
Oct 25 18:14:10 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:14:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the persistent domain config.
Oct 25 18:14:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:14:10 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:10 user nova-compute[74739]:   <source dev="/dev/sde"/>
Oct 25 18:14:10 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:14:10 user nova-compute[74739]:   <serial>da287983-ebf1-428a-ab74-560f18ce5401</serial>
Oct 25 18:14:10 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:14:10 user nova-compute[74739]: </disk>
Oct 25 18:14:10 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:14:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:14:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:14:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:14:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:14:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:25 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:26 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:14:29 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:14:29 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=7997MB free_disk=24.783794403076172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance e855c899-da17-49db-a2cd-e9166467e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 76e2435b-6e67-4872-864e-3cf596c384b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b5a734b0-ef37-4c03-806a-a0ca96985742 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:14:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 is timed out.
Oct 25 18:14:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully detached device vdb from instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 from the live domain config.
Oct 25 18:14:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtxRfNsP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:14:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2ec3f7-3f5e-42ef-8d96-ff2d1bc8b00f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:14:30 user nova-compute[74739]: No targets found.
Oct 25 18:14:30 user nova-compute[74739]: iSNS:
Oct 25 18:14:30 user nova-compute[74739]: No targets found.
Oct 25 18:14:30 user nova-compute[74739]: STATIC:
Oct 25 18:14:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401
Oct 25 18:14:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:14:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:14:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4
Oct 25 18:14:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:14:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:14:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:14:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:14:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:14:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:14:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:14:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:14:30 user nova-compute[74739]: FIRMWARE:
Oct 25 18:14:30 user nova-compute[74739]: No targets found.
Oct 25 18:14:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:14:30 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:14:30 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e35002e-5a90-47a1-be38-9704926fbea5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35ca762-5a4d-4c9a-b94a-bf7e6c492901]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 (non-flash)
Oct 25 18:14:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec54f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa6720-f6c9-4086-9715-02bcdbee074c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf97c335-4e84-4ec5-a7bb-39fd4ef2d37c]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1334df-0fc0-40bf-b971-4bba84adc4a5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8122a97-83e4-415b-8084-537b79ddd33e]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc448a6-f2b0-43e8-b11a-10f15519acb8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38f28ac-1992-4e11-a82e-c757252a54b0]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260]
Oct 25 18:14:31 user nova-compute[74739]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401, portal: 172.16.0.220,3260] successful.
Oct 25 18:14:31 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da287983-ebf1-428a-ab74-560f18ce5401 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d970a4bb-f4a4-4ed8-adf5-dfd0691b14ba]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] <== disconnect_volume: return (322ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'flavor' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:14:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-afa95b62-e900-4d1c-8fce-1cb773ebf7ae tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.952s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:14:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:14:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:45 user nova-compute[74739]: INFO nova.compute.manager [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Unrescuing
Oct 25 18:14:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:14:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'flavor' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:46 user nova-compute[74739]: WARNING nova.compute.manager [req-9116013c-e18c-4057-9a97-d3530319009d req-d130e86e-e694-4117-a08a-ea1539e0bc6c service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:14:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance destroyed successfully.
Oct 25 18:14:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:48 user nova-compute[74739]: WARNING nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:14:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:48 user nova-compute[74739]: WARNING nova.compute.manager [req-49041157-a829-4842-835b-dafcc6b66dcb req-2b8f8e0d-6eb6-4ec2-acd4-c41b749c8b9a service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:14:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8af41acc-fab1-4f9b-a6be-7ace74ed5fb0 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:14:50 user nova-compute[74739]: WARNING nova.compute.manager [req-dd02e1f4-2c3d-4c3c-b130-78f34c8347cd req-ee0c9eb1-450e-4912-9b25-8f664ca2a9b4 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state active and task_state None.
Oct 25 18:14:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:14:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:14:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:14:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:14:58 user nova-compute[74739]: INFO nova.compute.manager [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Detaching volume 68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:14:58 user nova-compute[74739]: INFO nova.virt.block_device [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Attempting to driver detach volume 68ac81ed-be41-4a74-947b-54c252fa3c23 from mountpoint /dev/vdb
Oct 25 18:14:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Attempting to detach device vdb from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:14:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:14:58 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:58 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:14:58 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:14:58 user nova-compute[74739]:   <serial>68ac81ed-be41-4a74-947b-54c252fa3c23</serial>
Oct 25 18:14:58 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 18:14:58 user nova-compute[74739]: </disk>
Oct 25 18:14:58 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:14:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully detached device vdb from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the persistent domain config.
Oct 25 18:14:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:14:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:14:58 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:14:58 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:14:58 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:14:58 user nova-compute[74739]:   <serial>68ac81ed-be41-4a74-947b-54c252fa3c23</serial>
Oct 25 18:14:58 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 25 18:14:58 user nova-compute[74739]: </disk>
Oct 25 18:14:58 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:14:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:15:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-changed-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG nova.compute.manager [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing instance network info cache due to event network-changed-de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] Acquiring lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] Acquired lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG nova.network.neutron [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Refreshing network info cache for port de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:16 user nova-compute[74739]: INFO nova.compute.manager [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Terminating instance
Oct 25 18:15:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-unplugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] No waiting events found dispatching network-vif-unplugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.compute.manager [req-901373b1-6eb4-4ec4-a3b7-75a4c99c4a8a req-6a32b497-53a8-4f39-84e5-a302e1c80ab8 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-unplugged-de08c67a-95c4-42ca-b133-29eec772daea for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:15:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Instance destroyed successfully.
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lazy-loading 'resources' on Instance uuid e855c899-da17-49db-a2cd-e9166467e0fa {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1640698855',display_name='tempest-TestStampPattern-server-1640698855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1640698855',id=34,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjI3CJRxevU495lIRtg8zIz8wWjQxeHNxG/QCbS0xXWfPDZJk5hk2v9sFWqzzFrZsS5urzecGuS7B5EviSk5FGxMWQLqVGUFo1rZJdcUxL1xWGlnXp6VjD3+O+yRd6u7Q==',key_name='tempest-TestStampPattern-831339939',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77c27c568e254f4e91bb7bc005ecbbf0',ramdisk_id='',reservation_id='r-cw54k07p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-156821719',owner_user_name='tempest-TestStampPattern-156821719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:10:54Z,user_data=None,user_id='3d4d5064cac7433aaf39069b94163ce0',uuid=e855c899-da17-49db-a2cd-e9166467e0fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converting VIF {"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG os_vif [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.neutron [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updated VIF entry in instance network info cache for port de08c67a-95c4-42ca-b133-29eec772daea. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.neutron [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [{"id": "de08c67a-95c4-42ca-b133-29eec772daea", "address": "fa:16:3e:47:32:5e", "network": {"id": "23b64643-3a27-457b-9c5e-1aff2f0c9476", "bridge": "br-int", "label": "tempest-TestStampPattern-1546510798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77c27c568e254f4e91bb7bc005ecbbf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde08c67a-95", "ovs_interfaceid": "de08c67a-95c4-42ca-b133-29eec772daea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde08c67a-95, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cd78fe5-b8fa-4596-8217-f8c37a927578) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:17 user nova-compute[74739]: INFO os_vif [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:32:5e,bridge_name='br-int',has_traffic_filtering=True,id=de08c67a-95c4-42ca-b133-29eec772daea,network=Network(23b64643-3a27-457b-9c5e-1aff2f0c9476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde08c67a-95')
Oct 25 18:15:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Deleting instance files /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa_del
Oct 25 18:15:17 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Deletion of /opt/stack/data/nova/instances/e855c899-da17-49db-a2cd-e9166467e0fa_del complete
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b66be5d-c83d-4358-a7e6-e45edace7430 req-766676a2-2228-4262-a743-66177efa6c8c service nova] Releasing lock "refresh_cache-e855c899-da17-49db-a2cd-e9166467e0fa" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:15:17 user nova-compute[74739]: INFO nova.compute.manager [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:15:17 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Took 0.40 seconds to deallocate network for instance.
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:18 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:15:18 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:15:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:18 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Deleted allocations for instance e855c899-da17-49db-a2cd-e9166467e0fa
Oct 25 18:15:18 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5545c914-d8c9-45a8-94fc-e21f656009d9 tempest-TestStampPattern-156821719 tempest-TestStampPattern-156821719-project-member] Lock "e855c899-da17-49db-a2cd-e9166467e0fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:19 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 is timed out.
Oct 25 18:15:19 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully detached device vdb from instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 from the live domain config.
Oct 25 18:15:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPxqzrlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:15:19 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2efd1aa-fabe-4512-9dd6-cc8070e49f7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:15:19 user nova-compute[74739]: No targets found.
Oct 25 18:15:19 user nova-compute[74739]: iSNS:
Oct 25 18:15:19 user nova-compute[74739]: No targets found.
Oct 25 18:15:19 user nova-compute[74739]: STATIC:
Oct 25 18:15:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4
Oct 25 18:15:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:15:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:15:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23
Oct 25 18:15:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:15:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:15:19 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:15:19 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:15:19 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:15:19 user nova-compute[74739]: FIRMWARE:
Oct 25 18:15:19 user nova-compute[74739]: No targets found.
Oct 25 18:15:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:15:19 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:15:19 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef23b1-d89c-4906-9fef-2cc5aaa1f6d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] Acquiring lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] Lock "e855c899-da17-49db-a2cd-e9166467e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] No waiting events found dispatching network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:19 user nova-compute[74739]: WARNING nova.compute.manager [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received unexpected event network-vif-plugged-de08c67a-95c4-42ca-b133-29eec772daea for instance with vm_state deleted and task_state None.
Oct 25 18:15:19 user nova-compute[74739]: DEBUG nova.compute.manager [req-1598951f-71fa-4019-a299-f693423cde4d req-245a3a82-f085-48ad-9ab5-749533c9b652 service nova] [instance: e855c899-da17-49db-a2cd-e9166467e0fa] Received event network-vif-deleted-de08c67a-95c4-42ca-b133-29eec772daea {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53e06a-9afe-4ceb-b80e-6dac2495f5a6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:15:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec5b2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07640f-1173-4b01-b8f4-98f6af29c1df]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba42e4a-19be-41c1-9d39-d68f27b8f976]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c14d2-1aa1-42b3-bdf8-ffeeaaf7c553]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4251e-e62b-48b8-b5e4-9986ef3f1600]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[45753cca-b781-4cd4-8e03-87cc2e5cfab4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[42924bd1-31d4-4b5b-9868-90ff9d25757b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260]
Oct 25 18:15:19 user nova-compute[74739]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23, portal: 172.16.0.220,3260] successful.
Oct 25 18:15:19 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68ac81ed-be41-4a74-947b-54c252fa3c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f76fbb-0ccb-493b-bf41-b0292c40e1be]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== disconnect_volume: return (311ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:15:19 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG nova.objects.instance [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'flavor' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-2fa7ad2d-b798-4064-8061-20b0adc0f572 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:15:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:26 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:27 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-changed-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Refreshing instance network info cache due to event network-changed-7af5b297-e9fb-451a-874e-b3e680fd76de. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] Acquiring lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] Acquired lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:15:28 user nova-compute[74739]: DEBUG nova.network.neutron [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Refreshing network info cache for port 7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG nova.network.neutron [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updated VIF entry in instance network info cache for port 7af5b297-e9fb-451a-874e-b3e680fd76de. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG nova.network.neutron [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updating instance_info_cache with network_info: [{"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:29 user nova-compute[74739]: INFO nova.compute.manager [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Terminating instance
Oct 25 18:15:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-02ad11a2-9f88-4cdc-96fd-9aa95103521b req-c4b2d61c-a8d1-47fd-8728-c9b5ac1b309a service nova] Releasing lock "refresh_cache-b5a734b0-ef37-4c03-806a-a0ca96985742" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:15:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Instance destroyed successfully.
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid b5a734b0-ef37-4c03-806a-a0ca96985742 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:15:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:15:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8174MB free_disk=24.90728759765625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-954113151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-954113151',id=41,image_ref='e478d4a6-f1bc-4206-9a78-a34b8782ae81',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKEqd2NKM471T/LtcHtHkxXaJt8JO43Fvk2AZDV45jjQ6bXUUvrrLf4WXqZEog3z+uvgg/Wg84xkmwxuXjq2UADXwRAIQsBwEmKb6WQtm543s1OiXwWML2+CwmX4JHj+g==',key_name='tempest-keypair-1623404985',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:14:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-bn5fxuyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2117961967',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=b5a734b0-ef37-4c03-806a-a0ca96985742,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7af5b297-e9fb-451a-874e-b3e680fd76de", "address": "fa:16:3e:09:82:54", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7af5b297-e9", "ovs_interfaceid": "7af5b297-e9fb-451a-874e-b3e680fd76de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_vif [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7af5b297-e9, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c360d003-c67a-48ad-b426-0522b11a5baf) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:30 user nova-compute[74739]: INFO os_vif [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:82:54,bridge_name='br-int',has_traffic_filtering=True,id=7af5b297-e9fb-451a-874e-b3e680fd76de,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7af5b297-e9')
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tVxpTbIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:15:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31382c8-152f-41ff-8181-6a92c1ee1065]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:15:30 user nova-compute[74739]: No targets found.
Oct 25 18:15:30 user nova-compute[74739]: iSNS:
Oct 25 18:15:30 user nova-compute[74739]: No targets found.
Oct 25 18:15:30 user nova-compute[74739]: STATIC:
Oct 25 18:15:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4
Oct 25 18:15:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:15:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:15:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:15:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:15:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:15:30 user nova-compute[74739]: FIRMWARE:
Oct 25 18:15:30 user nova-compute[74739]: No targets found.
Oct 25 18:15:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:15:30 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:15:30 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b0ecf-6bbb-4030-8733-835c7077d3ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 946e1724-bc8b-4212-bc34-007e56c5e2d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 76e2435b-6e67-4872-864e-3cf596c384b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b5a734b0-ef37-4c03-806a-a0ca96985742 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2bd39a-2bda-40d8-8a5d-8bca81e08f71]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:15:30 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:15:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:15:30 user nova-compute[74739]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 (non-flash)
Oct 25 18:15:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc191e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aea2678-3183-4dc6-bc2a-1740708c3feb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3fab3f-3b44-4666-855a-9b4d7101e769]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d8aef3-f24c-49c6-a849-8282504ca531]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790340d-6857-49e5-8d73-a3f8b662d8b4]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5709b3dc-ee91-4a01-884b-c40d3423c713]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddd5aeb-6a9c-4875-af45-512da35c6152]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260]
Oct 25 18:15:30 user nova-compute[74739]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4, portal: 172.16.0.220,3260] successful.
Oct 25 18:15:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-unplugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] No waiting events found dispatching network-vif-unplugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-unplugged-7af5b297-e9fb-451a-874e-b3e680fd76de for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Acquiring lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] No waiting events found dispatching network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:30 user nova-compute[74739]: WARNING nova.compute.manager [req-930691c0-add3-4a6d-b4b5-9561e09b7810 req-7661246e-0b52-4247-94ec-d81d4bc837f4 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received unexpected event network-vif-plugged-7af5b297-e9fb-451a-874e-b3e680fd76de for instance with vm_state active and task_state deleting.
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ab43ff1-4ccb-405b-85de-1b88c63bacc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55c4a16-ec53-434a-b8a2-85755ba20964]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (341ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:15:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Deleting instance files /opt/stack/data/nova/instances/b5a734b0-ef37-4c03-806a-a0ca96985742_del
Oct 25 18:15:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Deletion of /opt/stack/data/nova/instances/b5a734b0-ef37-4c03-806a-a0ca96985742_del complete
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:30 user nova-compute[74739]: INFO nova.compute.manager [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Took 1.55 seconds to destroy the instance on the hypervisor.
Oct 25 18:15:30 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:15:30 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:15:31 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:15:31 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Took 0.73 seconds to deallocate network for instance.
Oct 25 18:15:32 user nova-compute[74739]: INFO nova.compute.manager [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Took 0.90 seconds to detach 1 volumes for instance.
Oct 25 18:15:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Deleting volume: 2ab43ff1-4ccb-405b-85de-1b88c63bacc4 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:15:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-cdffca3b-0745-4d82-a876-8c5a97e0b6a5 req-e946b8ff-109e-4192-97e4-6c4912ce5a96 service nova] [instance: b5a734b0-ef37-4c03-806a-a0ca96985742] Received event network-vif-deleted-7af5b297-e9fb-451a-874e-b3e680fd76de {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:32 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:15:32 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:15:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:33 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance b5a734b0-ef37-4c03-806a-a0ca96985742
Oct 25 18:15:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f65e60e5-6db4-430a-9be2-e9951b566e27 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "b5a734b0-ef37-4c03-806a-a0ca96985742" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.736s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:15:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:15:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:48 user nova-compute[74739]: INFO nova.compute.manager [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Terminating instance
Oct 25 18:15:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-9828aa49-1fd8-4c10-ac7a-e0bf09bb8308 req-46d880c7-c60b-4ecf-810a-bda53fcb929c service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-unplugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Instance destroyed successfully.
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'resources' on Instance uuid 946e1724-bc8b-4212-bc34-007e56c5e2d3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-25T18:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1860947616',display_name='tempest-ServerActionsTestOtherA-server-541186523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1860947616',id=38,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIDfJlgYDOKO/8S4IWK1M9mbPbdtWe9XhSAdPkN9H7fBWegASvFXfE2drxgkqpBa+tzqXDMrj2ZCDMA6S5oev5qHeoNUdtthTfW3e/xMkeMMm9cGMPqWUz1oxyl9PB02g==',key_name='tempest-keypair-1232734981',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:12:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-9a08li30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=946e1724-bc8b-4212-bc34-007e56c5e2d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "74c5b044-088d-4258-808a-bc2b7199139b", "address": "fa:16:3e:a8:14:fe", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74c5b044-08", "ovs_interfaceid": "74c5b044-088d-4258-808a-bc2b7199139b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG os_vif [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74c5b044-08, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47450667-993c-446c-94e0-384f466c76f1) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:49 user nova-compute[74739]: INFO os_vif [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:14:fe,bridge_name='br-int',has_traffic_filtering=True,id=74c5b044-088d-4258-808a-bc2b7199139b,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74c5b044-08')
Oct 25 18:15:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Deleting instance files /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3_del
Oct 25 18:15:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Deletion of /opt/stack/data/nova/instances/946e1724-bc8b-4212-bc34-007e56c5e2d3_del complete
Oct 25 18:15:49 user nova-compute[74739]: INFO nova.compute.manager [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 25 18:15:49 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:15:49 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:15:50 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:15:50 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Took 0.83 seconds to deallocate network for instance.
Oct 25 18:15:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:50 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:15:50 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:15:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:50 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Deleted allocations for instance 946e1724-bc8b-4212-bc34-007e56c5e2d3
Oct 25 18:15:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1fd8c59b-e875-4129-8bb8-1a4981092faf tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] Acquiring lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:15:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:15:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] Lock "946e1724-bc8b-4212-bc34-007e56c5e2d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:15:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] No waiting events found dispatching network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:15:51 user nova-compute[74739]: WARNING nova.compute.manager [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received unexpected event network-vif-plugged-74c5b044-088d-4258-808a-bc2b7199139b for instance with vm_state deleted and task_state None.
Oct 25 18:15:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-4e77f7e9-bdef-4c2b-acd5-d4df68678af8 req-7c51a7c3-a33f-4fc5-be00-a715cde28084 service nova] [instance: 946e1724-bc8b-4212-bc34-007e56c5e2d3] Received event network-vif-deleted-74c5b044-088d-4258-808a-bc2b7199139b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:15:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:15:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:09 user nova-compute[74739]: INFO nova.compute.manager [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Terminating instance
Oct 25 18:16:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:09 user nova-compute[74739]: DEBUG nova.compute.manager [req-58c586e2-8b4c-41d3-af6f-2723443cd339 req-50fc551b-b6da-4ab5-bc2d-da1f44e6f571 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Instance destroyed successfully.
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.objects.instance [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lazy-loading 'resources' on Instance uuid 4a3046fd-9f36-420a-a8ca-e487df8a7db7 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:07:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2126427162',display_name='tempest-SnapshotDataIntegrityTests-server-2126427162',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2126427162',id=33,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISfm+lLprnNMnwr8si2QGlYDRM/QCIOctgtgHiDBRx7l31aye1sskuevvumEvhy/SckJhHH77muzlxjdoUaUGy0FSN+WQ8mwFtv46jFpfoe1dQtBbbkPOqjUMYjdkoI4Q==',key_name='tempest-keypair-1852589154',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aadec151f7634875b425e757c5997e77',ramdisk_id='',reservation_id='r-93k40ora',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1913790297',owner_user_name='tempest-SnapshotDataIntegrityTests-1913790297-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eabf9c2553e7486abc8e3ad8d319de31',uuid=4a3046fd-9f36-420a-a8ca-e487df8a7db7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converting VIF {"id": "b246d5fd-aa34-4191-bc43-600c0777db65", "address": "fa:16:3e:d5:12:89", "network": {"id": "eb773d79-3ae2-4620-a55d-96dfd7a5a5d2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-416146503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aadec151f7634875b425e757c5997e77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb246d5fd-aa", "ovs_interfaceid": "b246d5fd-aa34-4191-bc43-600c0777db65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG os_vif [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb246d5fd-aa, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b26831d-a4db-4267-a558-268f0c7f350f) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: INFO os_vif [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:12:89,bridge_name='br-int',has_traffic_filtering=True,id=b246d5fd-aa34-4191-bc43-600c0777db65,network=Network(eb773d79-3ae2-4620-a55d-96dfd7a5a5d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb246d5fd-aa')
Oct 25 18:16:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Deleting instance files /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7_del
Oct 25 18:16:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Deletion of /opt/stack/data/nova/instances/4a3046fd-9f36-420a-a8ca-e487df8a7db7_del complete
Oct 25 18:16:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:10 user nova-compute[74739]: INFO nova.compute.manager [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 18:16:10 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:16:10 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:16:11 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Took 1.03 seconds to deallocate network for instance.
Oct 25 18:16:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-6d631814-5db6-4abe-b775-cbcbeff7ab42 req-0413e9ad-a3f5-4ae7-84f2-1a37d0c7a5d4 service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-deleted-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:16:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:11 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Deleted allocations for instance 4a3046fd-9f36-420a-a8ca-e487df8a7db7
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-07dc7d92-8090-4d4a-b7c2-820839073e73 tempest-SnapshotDataIntegrityTests-1913790297 tempest-SnapshotDataIntegrityTests-1913790297-project-member] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:12 user nova-compute[74739]: WARNING nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state deleted and task_state None.
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:12 user nova-compute[74739]: WARNING nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state deleted and task_state None.
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:12 user nova-compute[74739]: WARNING nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state deleted and task_state None.
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:12 user nova-compute[74739]: WARNING nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-unplugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state deleted and task_state None.
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Acquiring lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] Lock "4a3046fd-9f36-420a-a8ca-e487df8a7db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:12 user nova-compute[74739]: DEBUG nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] No waiting events found dispatching network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:12 user nova-compute[74739]: WARNING nova.compute.manager [req-109f0531-3aa9-4c64-a9f2-f54cf8bb6d62 req-56c5c4f7-9732-4a63-b39c-875a147cac7a service nova] [instance: 4a3046fd-9f36-420a-a8ca-e487df8a7db7] Received unexpected event network-vif-plugged-b246d5fd-aa34-4191-bc43-600c0777db65 for instance with vm_state deleted and task_state None.
Oct 25 18:16:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:16:20 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:16:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:16:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:16:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:16:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:28 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:29 user nova-compute[74739]: INFO nova.compute.manager [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Terminating instance
Oct 25 18:16:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-24672fec-c0ed-427e-8a3f-8064630d057c req-edae3182-9911-486d-9c22-51b8271f8d3c service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Instance destroyed successfully.
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid 76e2435b-6e67-4872-864e-3cf596c384b3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:11:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1519363626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1519363626',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzqTUzLxvNqiwsVONkMCdKfSPtbB/uerUxLAdxHCtssHZiyOkTbu5o6Wj/8lBXcUDY46FX7W4uM48NAmLH72mlKyaOKjfnSH8WWsxLdEKND8nG59SMVNnALN5Xnk+ZYoA==',key_name='tempest-keypair-1351961818',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:12:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-qoazju06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=76e2435b-6e67-4872-864e-3cf596c384b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "address": "fa:16:3e:66:87:8a", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9ea8a4-87", "ovs_interfaceid": "7a9ea8a4-87ed-4737-a26f-8ebb29232cc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_vif [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9ea8a4-87, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88bd6932-af65-415a-8743-cf88797d2e6a) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: INFO os_vif [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:87:8a,bridge_name='br-int',has_traffic_filtering=True,id=7a9ea8a4-87ed-4737-a26f-8ebb29232cc2,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9ea8a4-87')
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MfGTDuWw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:16:30 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdb2160-ae8c-42ba-aec5-0feb91dceef0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:16:30 user nova-compute[74739]: No targets found.
Oct 25 18:16:30 user nova-compute[74739]: iSNS:
Oct 25 18:16:30 user nova-compute[74739]: No targets found.
Oct 25 18:16:30 user nova-compute[74739]: STATIC:
Oct 25 18:16:30 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423
Oct 25 18:16:30 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:16:30 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:16:30 user nova-compute[74739]: FIRMWARE:
Oct 25 18:16:30 user nova-compute[74739]: No targets found.
Oct 25 18:16:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:16:30 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:16:30 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a505f522-9552-463c-9a12-dcdb3b084a30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3a67a-2ab1-4fec-80e4-ac8c9a4ae405]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:16:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 (non-flash)
Oct 25 18:16:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc37a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e098111-e1df-43eb-9677-2f2cc36a0bbc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d3d31-9c5e-4e59-b285-138ac72e6601]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2017ba1f-bdd3-49a3-a722-bcfb6f8f54b2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892ac31-a30d-491b-beeb-94006e96ada2]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23837386632346163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4403c445', '/dev/disk/by-id/scsi-1SCST_BIO4403c445-878f24ac02e744f0') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3e17e-72c1-4214-ad1d-d49669ac3d95]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b924891-9844-459b-b53c-085a5ba77dcc]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c5cd7-57f6-4c40-aefa-fc8f42ced95e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260]
Oct 25 18:16:30 user nova-compute[74739]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423, portal: 172.16.0.220,3260] successful.
Oct 25 18:16:30 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47da12-536c-4dda-a58d-3277e179e8c0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (382ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:16:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Deleting instance files /opt/stack/data/nova/instances/76e2435b-6e67-4872-864e-3cf596c384b3_del
Oct 25 18:16:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Deletion of /opt/stack/data/nova/instances/76e2435b-6e67-4872-864e-3cf596c384b3_del complete
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:30 user nova-compute[74739]: INFO nova.compute.manager [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:16:30 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:16:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8577MB free_disk=24.96092987060547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 76e2435b-6e67-4872-864e-3cf596c384b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:31 user nova-compute[74739]: WARNING nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state active and task_state deleting.
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:31 user nova-compute[74739]: WARNING nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state active and task_state deleting.
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:31 user nova-compute[74739]: WARNING nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state active and task_state deleting.
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-unplugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Acquiring lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] Lock "76e2435b-6e67-4872-864e-3cf596c384b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] No waiting events found dispatching network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:31 user nova-compute[74739]: WARNING nova.compute.manager [req-687f39e5-8891-49ec-9f1e-16db20345324 req-b01b23ff-b8e6-458b-854b-d0e27f4f504b service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received unexpected event network-vif-plugged-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 for instance with vm_state active and task_state deleting.
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:16:31 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Took 1.04 seconds to deallocate network for instance.
Oct 25 18:16:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-9129cc60-d22b-42f6-95d6-56094956b11e req-06284395-2b66-45e7-81f9-8f90f3e05299 service nova] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Received event network-vif-deleted-7a9ea8a4-87ed-4737-a26f-8ebb29232cc2 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:32 user nova-compute[74739]: INFO nova.compute.manager [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Took 0.97 seconds to detach 1 volumes for instance.
Oct 25 18:16:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 76e2435b-6e67-4872-864e-3cf596c384b3] Deleting volume: e62d9b7e-fd50-4c25-bcad-ac9b8fc07423 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:16:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:32 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:16:32 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:16:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:32 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance 76e2435b-6e67-4872-864e-3cf596c384b3
Oct 25 18:16:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eb946b26-5d0b-4030-af34-f54ad7c68e80 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "76e2435b-6e67-4872-864e-3cf596c384b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.714s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:16:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:16:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:16:43 user nova-compute[74739]: INFO nova.compute.claims [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Claim successful on node user
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:16:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.policy [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fc3ef31d7e6446ea7f8667172ce012d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6417911f3bca47d08fbc396de0d54266', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:16:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Creating image(s)
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk 1073741824" returned: 0 in 0.069s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Successfully created port: f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.208s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Cannot resize image /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Ensure instance console log exists: /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Successfully updated port: f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing instance network info cache due to event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance network_info: |[{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start _get_guest_xml network_info=[{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:16:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:16:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1077796870',display_name='tempest-ServerRescueNegativeTestJSON-server-1077796870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1077796870',id=42,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu1SY1jEOTgWbm0QLhi+LujfNRrApUREMa5VU3G5HTEJVekPjMn/58omn1jJ6shWcQSorave53rwXl44MEZ5mHbnkX6Oja8FDbU/ynK9VddBGLZQ3x8qwchdjHneFrP+Q==',key_name='tempest-keypair-1611187428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-790gevkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=3cdbde0e-91ef-412c-b08e-0b5f815feada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:16:45 user nova-compute[74739]:   <uuid>3cdbde0e-91ef-412c-b08e-0b5f815feada</uuid>
Oct 25 18:16:45 user nova-compute[74739]:   <name>instance-0000002a</name>
Oct 25 18:16:45 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:16:45 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:16:45 user nova-compute[74739]:   <metadata>
Oct 25 18:16:45 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:16:45 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1077796870</nova:name>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:16:45</nova:creationTime>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:16:45 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:16:45 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:owner>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:16:45 user nova-compute[74739]:       </nova:owner>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:16:45 user nova-compute[74739]:       <nova:ports>
Oct 25 18:16:45 user nova-compute[74739]:         <nova:port uuid="f3c07012-c3a5-4828-b7e6-c16c56e2a120">
Oct 25 18:16:45 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 18:16:45 user nova-compute[74739]:         </nova:port>
Oct 25 18:16:45 user nova-compute[74739]:       </nova:ports>
Oct 25 18:16:45 user nova-compute[74739]:     </nova:instance>
Oct 25 18:16:45 user nova-compute[74739]:   </metadata>
Oct 25 18:16:45 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:16:45 user nova-compute[74739]:     <system>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="serial">3cdbde0e-91ef-412c-b08e-0b5f815feada</entry>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="uuid">3cdbde0e-91ef-412c-b08e-0b5f815feada</entry>
Oct 25 18:16:45 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:16:45 user nova-compute[74739]:     </system>
Oct 25 18:16:45 user nova-compute[74739]:   </sysinfo>
Oct 25 18:16:45 user nova-compute[74739]:   <os>
Oct 25 18:16:45 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:16:45 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:16:45 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:16:45 user nova-compute[74739]:   </os>
Oct 25 18:16:45 user nova-compute[74739]:   <features>
Oct 25 18:16:45 user nova-compute[74739]:     <acpi/>
Oct 25 18:16:45 user nova-compute[74739]:     <apic/>
Oct 25 18:16:45 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:16:45 user nova-compute[74739]:   </features>
Oct 25 18:16:45 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:16:45 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:16:45 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:16:45 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:16:45 user nova-compute[74739]:   </clock>
Oct 25 18:16:45 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:16:45 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:16:45 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:16:45 user nova-compute[74739]:   </cpu>
Oct 25 18:16:45 user nova-compute[74739]:   <devices>
Oct 25 18:16:45 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:16:45 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:16:45 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk"/>
Oct 25 18:16:45 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:16:45 user nova-compute[74739]:     </disk>
Oct 25 18:16:45 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:16:45 user nova-compute[74739]:       <mac address="fa:16:3e:3d:19:72"/>
Oct 25 18:16:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:16:45 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:16:45 user nova-compute[74739]:       <target dev="tapf3c07012-c3"/>
Oct 25 18:16:45 user nova-compute[74739]:     </interface>
Oct 25 18:16:45 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:16:45 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/console.log" append="off"/>
Oct 25 18:16:45 user nova-compute[74739]:     </serial>
Oct 25 18:16:45 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:16:45 user nova-compute[74739]:     <video>
Oct 25 18:16:45 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:16:45 user nova-compute[74739]:     </video>
Oct 25 18:16:45 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:16:45 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:16:45 user nova-compute[74739]:     </rng>
Oct 25 18:16:45 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:16:45 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:16:45 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:16:45 user nova-compute[74739]:     </memballoon>
Oct 25 18:16:45 user nova-compute[74739]:   </devices>
Oct 25 18:16:45 user nova-compute[74739]: </domain>
Oct 25 18:16:45 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1077796870',display_name='tempest-ServerRescueNegativeTestJSON-server-1077796870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1077796870',id=42,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu1SY1jEOTgWbm0QLhi+LujfNRrApUREMa5VU3G5HTEJVekPjMn/58omn1jJ6shWcQSorave53rwXl44MEZ5mHbnkX6Oja8FDbU/ynK9VddBGLZQ3x8qwchdjHneFrP+Q==',key_name='tempest-keypair-1611187428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-790gevkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=3cdbde0e-91ef-412c-b08e-0b5f815feada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG os_vif [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73502699-4224-5574-8196-60553d930113', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3c07012-c3, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3c07012-c3, col_values=(('qos', UUID('822be9d0-b6fa-4f2e-a957-7e43309f4237')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3c07012-c3, col_values=(('external_ids', {'iface-id': 'f3c07012-c3a5-4828-b7e6-c16c56e2a120', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:19:72', 'vm-uuid': '3cdbde0e-91ef-412c-b08e-0b5f815feada'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:45 user nova-compute[74739]: INFO os_vif [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3')
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:3d:19:72, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updated VIF entry in instance network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:16:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-de472b46-9a7c-4b5a-8380-cb83378ca86f req-fedbe08c-2488-49a3-93d4-44489f39a3b9 service nova] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:47 user nova-compute[74739]: WARNING nova.compute.manager [req-04d5f101-128f-45b4-8347-9188cc7498b4 req-eab01b91-e92a-4d56-a087-0d356145d1c9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state building and task_state spawning.
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:16:49 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance spawned successfully.
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:16:49 user nova-compute[74739]: WARNING nova.compute.manager [req-1d4f1bbe-463e-4ef4-905e-1da8102ff5d6 req-480a6f99-d327-400b-8eed-031ea10adde0 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state building and task_state spawning.
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:16:49 user nova-compute[74739]: INFO nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 25 18:16:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:16:49 user nova-compute[74739]: INFO nova.compute.manager [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Took 6.30 seconds to build instance.
Oct 25 18:16:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-24a4591e-63d8-4bfc-a980-9cb43f06cacf tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.412s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:16:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:16:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:17:20 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:17:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:17:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:17:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:17:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:30 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:17:33 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=24.921363830566406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:17:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:38 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:17:39 user nova-compute[74739]: INFO nova.compute.claims [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Claim successful on node user
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:17:39 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.policy [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:17:39 user nova-compute[74739]: INFO nova.virt.block_device [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Booting with volume 5df8714f-b7b9-405b-8333-201b45635d5e at /dev/vda
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.utils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4fdefc-3c4c-457e-b2c8-ba329f6ea1b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10af35a-ea46-4465-a159-e8220a4df3ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386f7ab-3c02-4194-9920-89f4a547a543]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[71754010-6dde-433c-a030-3530e588669f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:17:39 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:17:39 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[01679cdc-7f51-4da1-859f-0db207e4ed68]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG os_brick.utils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:17:39 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating existing volume attachment record: b47f48c7-b6f4-470b-94bf-4d30be60872f {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Successfully created port: a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Successfully updated port: a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-changed-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Refreshing instance network info cache due to event network-changed-a02403dc-bae3-4b37-994c-c8034e51b276. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:17:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] Acquiring lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating instance_info_cache with network_info: [{"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Instance network_info: |[{"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] Acquired lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG nova.network.neutron [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Refreshing network info cache for port a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG nova.network.neutron [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updated VIF entry in instance network info cache for port a02403dc-bae3-4b37-994c-c8034e51b276. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG nova.network.neutron [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating instance_info_cache with network_info: [{"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:17:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f3299066-20b4-468c-ae40-c81c01f8b0d5 req-174ce9b0-89cb-42c1-89e0-34b20980d178 service nova] Releasing lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:17:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:17:56 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Creating image(s)
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Ensure instance console log exists: /opt/stack/data/nova/instances/3f6c1c31-99ea-44f4-b719-d64183915e06/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Start _get_guest_xml network_info=[{"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'b47f48c7-b6f4-470b-94bf-4d30be60872f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f6c1c31-99ea-44f4-b719-d64183915e06', 'attached_at': '', 'detached_at': '', 'volume_id': '5df8714f-b7b9-405b-8333-201b45635d5e', 'serial': '5df8714f-b7b9-405b-8333-201b45635d5e'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:17:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:17:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:17:56 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:17:56 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:17:56 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c78ef-82f1-42f2-9690-958f651a4c61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:17:56 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ad2458-a31b-4095-be66-5732c0d9c36e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e] added
Oct 25 18:17:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788b0a8-2e70-4555-abd9-a8c9f79d19b4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeba6b4-45e9-49b8-93ab-f0ca751df425]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPqjJTBc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPqjJTBc" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac3da46-3216-4976-bf4f-b45bc4139aed]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPqjJTBc'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27ad4ec-ef14-47a2-a1bd-3f20781cbb2b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3337f-151c-4cc2-a7d2-b49fd0326dc8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:17:56 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:17:56 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:17:56 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:17:56 user nova-compute[74739]: 
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[591bae06-1804-4da7-a926-0ed3d919df77]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]
Oct 25 18:17:56 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.
Oct 25 18:17:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e703406-bd37-4274-b68b-3508b379525b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2203a0-10dc-445b-bd9e-103613adf802]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:17:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:17:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8378701a-4e85-49aa-be85-60b59c1ee9d5]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:17:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:17:57 user nova-compute[74739]: INFO nova.compute.claims [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Claim successful on node user
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:17:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.policy [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0a42eef8b354d4fad0b4eb277270cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2286f0b19a436897ed0d9c42991e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:17:57 user nova-compute[74739]: INFO nova.virt.block_device [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Booting with volume 01b3d884-5cd5-4f05-a7e9-8c34958363c6 at /dev/vda
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.utils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[646525ce-9b85-48c9-b6b9-248f46222c7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc4d857-3783-49c7-b2bd-86ec66aa3ed4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77c1751-b60c-45da-a5e7-aa89ac1b486d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5719e-19e9-407c-9a46-0b8a334b89f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:17:57 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:17:57 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2b64e-cd32-4b5f-89cc-f90cf7bd25f1]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.utils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating existing volume attachment record: 25fe3b79-73b7-4f0e-a5dd-914145862faa {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23434626433646264', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434626433646264', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1947336246',display_name='tempest-TestVolumeBootPattern-server-1947336246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1947336246',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-v9o80w2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:17:39Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=3f6c1c31-99ea-44f4-b719-d64183915e06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f6c1c31-99ea-44f4-b719-d64183915e06 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:17:57 user nova-compute[74739]:   <uuid>3f6c1c31-99ea-44f4-b719-d64183915e06</uuid>
Oct 25 18:17:57 user nova-compute[74739]:   <name>instance-0000002b</name>
Oct 25 18:17:57 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:17:57 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:17:57 user nova-compute[74739]:   <metadata>
Oct 25 18:17:57 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:17:57 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:17:57 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-server-1947336246</nova:name>
Oct 25 18:17:57 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:17:56</nova:creationTime>
Oct 25 18:17:57 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:17:57 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:17:57 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:17:57 user nova-compute[74739]:       <nova:owner>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:17:57 user nova-compute[74739]:       </nova:owner>
Oct 25 18:17:57 user nova-compute[74739]:       <nova:ports>
Oct 25 18:17:57 user nova-compute[74739]:         <nova:port uuid="a02403dc-bae3-4b37-994c-c8034e51b276">
Oct 25 18:17:57 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 25 18:17:57 user nova-compute[74739]:         </nova:port>
Oct 25 18:17:57 user nova-compute[74739]:       </nova:ports>
Oct 25 18:17:57 user nova-compute[74739]:     </nova:instance>
Oct 25 18:17:57 user nova-compute[74739]:   </metadata>
Oct 25 18:17:57 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:17:57 user nova-compute[74739]:     <system>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="serial">3f6c1c31-99ea-44f4-b719-d64183915e06</entry>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="uuid">3f6c1c31-99ea-44f4-b719-d64183915e06</entry>
Oct 25 18:17:57 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:17:57 user nova-compute[74739]:     </system>
Oct 25 18:17:57 user nova-compute[74739]:   </sysinfo>
Oct 25 18:17:57 user nova-compute[74739]:   <os>
Oct 25 18:17:57 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:17:57 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:17:57 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:17:57 user nova-compute[74739]:   </os>
Oct 25 18:17:57 user nova-compute[74739]:   <features>
Oct 25 18:17:57 user nova-compute[74739]:     <acpi/>
Oct 25 18:17:57 user nova-compute[74739]:     <apic/>
Oct 25 18:17:57 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:17:57 user nova-compute[74739]:   </features>
Oct 25 18:17:57 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:17:57 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:17:57 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:17:57 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:17:57 user nova-compute[74739]:   </clock>
Oct 25 18:17:57 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:17:57 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:17:57 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:17:57 user nova-compute[74739]:   </cpu>
Oct 25 18:17:57 user nova-compute[74739]:   <devices>
Oct 25 18:17:57 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:17:57 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:17:57 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 18:17:57 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:17:57 user nova-compute[74739]:       <serial>5df8714f-b7b9-405b-8333-201b45635d5e</serial>
Oct 25 18:17:57 user nova-compute[74739]:     </disk>
Oct 25 18:17:57 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:17:57 user nova-compute[74739]:       <mac address="fa:16:3e:de:90:ce"/>
Oct 25 18:17:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:17:57 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:17:57 user nova-compute[74739]:       <target dev="tapa02403dc-ba"/>
Oct 25 18:17:57 user nova-compute[74739]:     </interface>
Oct 25 18:17:57 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:17:57 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3f6c1c31-99ea-44f4-b719-d64183915e06/console.log" append="off"/>
Oct 25 18:17:57 user nova-compute[74739]:     </serial>
Oct 25 18:17:57 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:17:57 user nova-compute[74739]:     <video>
Oct 25 18:17:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:17:57 user nova-compute[74739]:     </video>
Oct 25 18:17:57 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:17:57 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:17:57 user nova-compute[74739]:     </rng>
Oct 25 18:17:57 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:17:57 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:17:57 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:17:57 user nova-compute[74739]:     </memballoon>
Oct 25 18:17:57 user nova-compute[74739]:   </devices>
Oct 25 18:17:57 user nova-compute[74739]: </domain>
Oct 25 18:17:57 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1947336246',display_name='tempest-TestVolumeBootPattern-server-1947336246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1947336246',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-v9o80w2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:17:39Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=3f6c1c31-99ea-44f4-b719-d64183915e06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG os_vif [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4bc2e42-ea83-5add-9c86-71527ece6ae2', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa02403dc-ba, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa02403dc-ba, col_values=(('qos', UUID('e6e70d47-07fb-4314-89e7-67c6cbdc6b7b')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa02403dc-ba, col_values=(('external_ids', {'iface-id': 'a02403dc-bae3-4b37-994c-c8034e51b276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:90:ce', 'vm-uuid': '3f6c1c31-99ea-44f4-b719-d64183915e06'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:57 user nova-compute[74739]: INFO os_vif [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba')
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:17:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:de:90:ce, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Successfully created port: 518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Successfully updated port: 518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-changed-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Refreshing instance network info cache due to event network-changed-518cf5bf-9316-4661-ab79-d40cd6405a99. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:17:58 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.network.neutron [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance network_info: |[{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Refreshing network info cache for port 518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:17:59 user nova-compute[74739]: WARNING nova.compute.manager [req-367967e5-f532-4213-9779-6c4e2ba03cf5 req-0e523553-71f1-478d-b4a2-a519b757b3f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state building and task_state spawning.
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updated VIF entry in instance network info cache for port 518cf5bf-9316-4661-ab79-d40cd6405a99. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG nova.network.neutron [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-742f475d-1c00-4689-a8d9-9b73b9d34d8a req-4ea2d894-905b-4f54-a7d5-c38769c6d22f service nova] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:17:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:18:01 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Instance spawned successfully.
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:01 user nova-compute[74739]: INFO nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:01 user nova-compute[74739]: DEBUG nova.compute.manager [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:18:01 user nova-compute[74739]: WARNING nova.compute.manager [req-2f94a72a-123f-47c1-9b59-92f0aa6e5cce req-c892b26f-b850-406f-b1b2-7531e1b019be service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state building and task_state spawning.
Oct 25 18:18:01 user nova-compute[74739]: INFO nova.compute.manager [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Took 22.49 seconds to build instance.
Oct 25 18:18:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-126c8c9a-22fe-4270-8c66-58677af16ab2 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.590s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:18:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:18:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Creating image(s)
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Ensure instance console log exists: /opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start _get_guest_xml network_info=[{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '25fe3b79-73b7-4f0e-a5dd-914145862faa', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b1be4b31-34e2-4e28-a9af-e928087a34c3', 'attached_at': '', 'detached_at': '', 'volume_id': '01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'serial': '01b3d884-5cd5-4f05-a7e9-8c34958363c6'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:18:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:23 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:18:23 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:18:23 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:18:23 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef5bef3-a488-4f2a-8ed0-16998fbea0b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:18:23 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db37237-234e-45b8-a27d-861816afb109]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6] added
Oct 25 18:18:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59690ea9-5034-4b85-869d-3431b6e0fa32]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b90d21-12d5-499c-b87e-b2248a4dd4cd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjdmyFZB {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjdmyFZB" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[467b82b2-4f3a-4e1a-92b7-d65b4d7e6c69]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjdmyFZB'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3cc590-da8f-4ff1-910b-450b585de296]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f64a52-634e-4205-ba30-3dc6b61e7704]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.245s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099474a-7988-438b-a15c-953967a176b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]
Oct 25 18:18:24 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.
Oct 25 18:18:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c732e35c-9f22-4e9f-94e7-21c180c75f00]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5f352-30a7-4c9a-a812-0956bebd99e0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:24 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:24 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82595dd-3ffa-4aee-941e-fe6064d27fde]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23331303162623531', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331303162623531', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.objects.instance [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'pci_devices' on Instance uuid b1be4b31-34e2-4e28-a9af-e928087a34c3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:18:25 user nova-compute[74739]:   <uuid>b1be4b31-34e2-4e28-a9af-e928087a34c3</uuid>
Oct 25 18:18:25 user nova-compute[74739]:   <name>instance-0000002c</name>
Oct 25 18:18:25 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:18:25 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:18:25 user nova-compute[74739]:   <metadata>
Oct 25 18:18:25 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:18:25 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:18:25 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherA-server-761348612</nova:name>
Oct 25 18:18:25 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:18:23</nova:creationTime>
Oct 25 18:18:25 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:18:25 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:18:25 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:18:25 user nova-compute[74739]:       <nova:owner>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:user uuid="b0a42eef8b354d4fad0b4eb277270cb4">tempest-ServerActionsTestOtherA-1860404749-project-member</nova:user>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:project uuid="ee2286f0b19a436897ed0d9c42991e06">tempest-ServerActionsTestOtherA-1860404749</nova:project>
Oct 25 18:18:25 user nova-compute[74739]:       </nova:owner>
Oct 25 18:18:25 user nova-compute[74739]:       <nova:ports>
Oct 25 18:18:25 user nova-compute[74739]:         <nova:port uuid="518cf5bf-9316-4661-ab79-d40cd6405a99">
Oct 25 18:18:25 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 18:18:25 user nova-compute[74739]:         </nova:port>
Oct 25 18:18:25 user nova-compute[74739]:       </nova:ports>
Oct 25 18:18:25 user nova-compute[74739]:     </nova:instance>
Oct 25 18:18:25 user nova-compute[74739]:   </metadata>
Oct 25 18:18:25 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:18:25 user nova-compute[74739]:     <system>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="serial">b1be4b31-34e2-4e28-a9af-e928087a34c3</entry>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="uuid">b1be4b31-34e2-4e28-a9af-e928087a34c3</entry>
Oct 25 18:18:25 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:18:25 user nova-compute[74739]:     </system>
Oct 25 18:18:25 user nova-compute[74739]:   </sysinfo>
Oct 25 18:18:25 user nova-compute[74739]:   <os>
Oct 25 18:18:25 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:18:25 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:18:25 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:18:25 user nova-compute[74739]:   </os>
Oct 25 18:18:25 user nova-compute[74739]:   <features>
Oct 25 18:18:25 user nova-compute[74739]:     <acpi/>
Oct 25 18:18:25 user nova-compute[74739]:     <apic/>
Oct 25 18:18:25 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:18:25 user nova-compute[74739]:   </features>
Oct 25 18:18:25 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:18:25 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:18:25 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:18:25 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:18:25 user nova-compute[74739]:   </clock>
Oct 25 18:18:25 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:18:25 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:18:25 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:18:25 user nova-compute[74739]:   </cpu>
Oct 25 18:18:25 user nova-compute[74739]:   <devices>
Oct 25 18:18:25 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:18:25 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:18:25 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 18:18:25 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:18:25 user nova-compute[74739]:       <serial>01b3d884-5cd5-4f05-a7e9-8c34958363c6</serial>
Oct 25 18:18:25 user nova-compute[74739]:     </disk>
Oct 25 18:18:25 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:18:25 user nova-compute[74739]:       <mac address="fa:16:3e:64:df:81"/>
Oct 25 18:18:25 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:18:25 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:18:25 user nova-compute[74739]:       <target dev="tap518cf5bf-93"/>
Oct 25 18:18:25 user nova-compute[74739]:     </interface>
Oct 25 18:18:25 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:18:25 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3/console.log" append="off"/>
Oct 25 18:18:25 user nova-compute[74739]:     </serial>
Oct 25 18:18:25 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:18:25 user nova-compute[74739]:     <video>
Oct 25 18:18:25 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:18:25 user nova-compute[74739]:     </video>
Oct 25 18:18:25 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:18:25 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:18:25 user nova-compute[74739]:     </rng>
Oct 25 18:18:25 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:18:25 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:18:25 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:18:25 user nova-compute[74739]:     </memballoon>
Oct 25 18:18:25 user nova-compute[74739]:   </devices>
Oct 25 18:18:25 user nova-compute[74739]: </domain>
Oct 25 18:18:25 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG os_vif [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2db0b9b-0739-52fe-9dae-b3b47b832436', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap518cf5bf-93, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap518cf5bf-93, col_values=(('qos', UUID('19c430b3-8742-48eb-8600-481995e35eb2')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap518cf5bf-93, col_values=(('external_ids', {'iface-id': '518cf5bf-9316-4661-ab79-d40cd6405a99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:df:81', 'vm-uuid': 'b1be4b31-34e2-4e28-a9af-e928087a34c3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: INFO os_vif [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93')
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:64:df:81, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:18:26 user nova-compute[74739]: WARNING nova.compute.manager [req-5d6a2599-bd9e-436c-9f10-41e90077a30b req-ffdf024c-d696-4f39-a620-90963e11bb06 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state building and task_state spawning.
Oct 25 18:18:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:18:28 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance spawned successfully.
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:18:28 user nova-compute[74739]: INFO nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:18:28 user nova-compute[74739]: INFO nova.compute.manager [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Took 31.90 seconds to build instance.
Oct 25 18:18:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-be96a49f-7b53-4277-b880-a547e2ca1cfa tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.987s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:18:29 user nova-compute[74739]: WARNING nova.compute.manager [req-e3ef4590-6ad9-4dcb-baec-edbbe9b24a97 req-22458cca-ff3b-4525-b6bd-f72e22bf6885 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state None.
Oct 25 18:18:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing instance network info cache due to event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:18:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=24.918357849121094GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'flavor' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3f6c1c31-99ea-44f4-b719-d64183915e06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updated VIF entry in instance network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.network.neutron [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:34 user nova-compute[74739]: INFO nova.compute.manager [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Attaching volume e4c4d91f-3129-4221-95bf-e33cae717741 to /dev/vdb
Oct 25 18:18:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2d97a29f-35ea-4004-86cf-286768a71adb req-f7428a55-dd6a-4fe4-be17-f07ee5705797 service nova] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG os_brick.utils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e862b-e08a-4f74-9174-5e6500dbc5c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49fc324-b1e0-4c0a-8e71-eba9702086a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef145797-3b80-4f47-9e3d-8f0f8442b5c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a16ba-8d08-4795-80bb-98eb8fb18c57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:18:35 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b746c7c-8211-4a06-8611-f8f2a9bd6ea5]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG os_brick.utils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating existing volume attachment record: 7245b53d-dc46-4441-9dab-e98a725032dc {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:18:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:18:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:18:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIzVgLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:18:52 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:18:52 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:18:52 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162a1bf-b72f-44ff-9151-67eb064e39c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:18:52 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd42e4d-466c-4254-82b9-a9da7dcb9304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741] added
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ccf46-22a1-4c00-adc7-f9367b30b57d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6459f0-9a16-436e-a199-431b5534fb80]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIzVgLDY {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MIzVgLDY" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4785f85-bfed-4d4a-96f9-961c7fc7b0e9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MIzVgLDY'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[196b5a6b-2df0-48ca-b83e-e5587c7f42b4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f806ea0-be62-4df4-98f5-54be53b78077]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb6b5d-1733-4fee-a6a8-d07af939a345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260]
Oct 25 18:18:52 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260] successful.
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0681948-3b28-4a66-8cd6-3427e5815dad]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5112649a-212e-4568-95dc-0dab2c5eb0a3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:18:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e562c-4e0e-4ee4-8c4e-001100116111]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:18:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIzVgLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:18:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:18:53 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23932643162653563', 'path': '/dev/sdd'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:18:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932643162653563', 'path': '/dev/sdd'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:18:53 user nova-compute[74739]: DEBUG nova.objects.instance [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'flavor' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:18:54 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:18:54 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:18:54 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:18:54 user nova-compute[74739]:   <serial>e4c4d91f-3129-4221-95bf-e33cae717741</serial>
Oct 25 18:18:54 user nova-compute[74739]: </disk>
Oct 25 18:18:54 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:18:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:18:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:18:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:3d:19:72, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:18:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-ce3cc47c-e62b-4b51-8a27-f70a495fea9c tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.711s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:55 user nova-compute[74739]: INFO nova.compute.manager [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Rescuing
Oct 25 18:18:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:18:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:18:55 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:18:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:18:56 user nova-compute[74739]: WARNING nova.compute.manager [req-2fb093c5-63a0-4761-9d96-617fa931cd4c req-4c8462d3-68d1-4e57-ae53-09c3957b0caf service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state active and task_state rescuing.
Oct 25 18:18:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance destroyed successfully.
Oct 25 18:18:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Attempting rescue
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74739) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 18:18:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Creating image(s)
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue" returned: 0 in 0.047s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'migration_context' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.base [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<3cdbde0e-91ef-412c-b08e-0b5f815feada> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start _get_guest_xml network_info=[{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:3d:19:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.base [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<3cdbde0e-91ef-412c-b08e-0b5f815feada> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.base [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<3cdbde0e-91ef-412c-b08e-0b5f815feada> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:18:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.base [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<3cdbde0e-91ef-412c-b08e-0b5f815feada> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1077796870',display_name='tempest-ServerRescueNegativeTestJSON-server-1077796870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1077796870',id=42,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu1SY1jEOTgWbm0QLhi+LujfNRrApUREMa5VU3G5HTEJVekPjMn/58omn1jJ6shWcQSorave53rwXl44MEZ5mHbnkX6Oja8FDbU/ynK9VddBGLZQ3x8qwchdjHneFrP+Q==',key_name='tempest-keypair-1611187428',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-790gevkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:16:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=3cdbde0e-91ef-412c-b08e-0b5f815feada,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:3d:19:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "vif_mac": "fa:16:3e:3d:19:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.objects.base [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Object Instance<3cdbde0e-91ef-412c-b08e-0b5f815feada> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:18:57 user nova-compute[74739]:   <uuid>3cdbde0e-91ef-412c-b08e-0b5f815feada</uuid>
Oct 25 18:18:57 user nova-compute[74739]:   <name>instance-0000002a</name>
Oct 25 18:18:57 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:18:57 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:18:57 user nova-compute[74739]:   <metadata>
Oct 25 18:18:57 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:18:57 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1077796870</nova:name>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:18:57</nova:creationTime>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:18:57 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:18:57 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:owner>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:user uuid="2fc3ef31d7e6446ea7f8667172ce012d">tempest-ServerRescueNegativeTestJSON-249751618-project-member</nova:user>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:project uuid="6417911f3bca47d08fbc396de0d54266">tempest-ServerRescueNegativeTestJSON-249751618</nova:project>
Oct 25 18:18:57 user nova-compute[74739]:       </nova:owner>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:18:57 user nova-compute[74739]:       <nova:ports>
Oct 25 18:18:57 user nova-compute[74739]:         <nova:port uuid="f3c07012-c3a5-4828-b7e6-c16c56e2a120">
Oct 25 18:18:57 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 25 18:18:57 user nova-compute[74739]:         </nova:port>
Oct 25 18:18:57 user nova-compute[74739]:       </nova:ports>
Oct 25 18:18:57 user nova-compute[74739]:     </nova:instance>
Oct 25 18:18:57 user nova-compute[74739]:   </metadata>
Oct 25 18:18:57 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:18:57 user nova-compute[74739]:     <system>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="serial">3cdbde0e-91ef-412c-b08e-0b5f815feada</entry>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="uuid">3cdbde0e-91ef-412c-b08e-0b5f815feada</entry>
Oct 25 18:18:57 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:18:57 user nova-compute[74739]:     </system>
Oct 25 18:18:57 user nova-compute[74739]:   </sysinfo>
Oct 25 18:18:57 user nova-compute[74739]:   <os>
Oct 25 18:18:57 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:18:57 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:18:57 user nova-compute[74739]:   </os>
Oct 25 18:18:57 user nova-compute[74739]:   <features>
Oct 25 18:18:57 user nova-compute[74739]:     <acpi/>
Oct 25 18:18:57 user nova-compute[74739]:     <apic/>
Oct 25 18:18:57 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:18:57 user nova-compute[74739]:   </features>
Oct 25 18:18:57 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:18:57 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:18:57 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:18:57 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:18:57 user nova-compute[74739]:   </clock>
Oct 25 18:18:57 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:18:57 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:18:57 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:18:57 user nova-compute[74739]:   </cpu>
Oct 25 18:18:57 user nova-compute[74739]:   <devices>
Oct 25 18:18:57 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:18:57 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:18:57 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue"/>
Oct 25 18:18:57 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:18:57 user nova-compute[74739]:     </disk>
Oct 25 18:18:57 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:18:57 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:18:57 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk"/>
Oct 25 18:18:57 user nova-compute[74739]:       <target dev="vdb" bus="virtio"/>
Oct 25 18:18:57 user nova-compute[74739]:     </disk>
Oct 25 18:18:57 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:18:57 user nova-compute[74739]:       <mac address="fa:16:3e:3d:19:72"/>
Oct 25 18:18:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:18:57 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:18:57 user nova-compute[74739]:       <target dev="tapf3c07012-c3"/>
Oct 25 18:18:57 user nova-compute[74739]:     </interface>
Oct 25 18:18:57 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:18:57 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/console.log" append="off"/>
Oct 25 18:18:57 user nova-compute[74739]:     </serial>
Oct 25 18:18:57 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:18:57 user nova-compute[74739]:     <video>
Oct 25 18:18:57 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:18:57 user nova-compute[74739]:     </video>
Oct 25 18:18:57 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:18:57 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:18:57 user nova-compute[74739]:     </rng>
Oct 25 18:18:57 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:18:57 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:18:57 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:18:57 user nova-compute[74739]:     </memballoon>
Oct 25 18:18:57 user nova-compute[74739]:   </devices>
Oct 25 18:18:57 user nova-compute[74739]: </domain>
Oct 25 18:18:57 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:18:57 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance destroyed successfully.
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:18:57 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] No VIF found with MAC fa:16:3e:3d:19:72, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG nova.compute.manager [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:18:58 user nova-compute[74739]: WARNING nova.compute.manager [req-671ce63a-8f87-4dff-92da-6a840437f91a req-2b100871-5eb5-40b2-9551-7b8623651547 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state active and task_state rescuing.
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:18:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:00 user nova-compute[74739]: WARNING nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state active and task_state rescuing.
Oct 25 18:19:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:00 user nova-compute[74739]: WARNING nova.compute.manager [req-ea12c58e-9d4a-4f4e-9492-b15ca807fdc4 req-76b7c32e-39dd-42ec-b646-731d3e756104 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state active and task_state rescuing.
Oct 25 18:19:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f5c010a8-6c00-4083-89ed-bc4448ab66c6 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:19:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:19:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:19:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-changed-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Refreshing instance network info cache due to event network-changed-a02403dc-bae3-4b37-994c-c8034e51b276. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] Acquiring lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] Acquired lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG nova.network.neutron [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Refreshing network info cache for port a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:19:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updated VIF entry in instance network info cache for port a02403dc-bae3-4b37-994c-c8034e51b276. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating instance_info_cache with network_info: [{"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-45743a14-85ac-4616-8fc7-17fca5fa9e47 req-28cbbf5a-a3b0-4208-a05a-1644198dd2f3 service nova] Releasing lock "refresh_cache-3f6c1c31-99ea-44f4-b719-d64183915e06" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:31 user nova-compute[74739]: INFO nova.compute.manager [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Terminating instance
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-ab8125a3-a2fe-4b61-98bb-c510e198ff12 req-d7bcfd85-c1b1-4e0c-a6a5-091643e3fd5b service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Instance destroyed successfully.
Oct 25 18:19:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid 3f6c1c31-99ea-44f4-b719-d64183915e06 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1947336246',display_name='tempest-TestVolumeBootPattern-server-1947336246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1947336246',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-v9o80w2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:18:01Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=3f6c1c31-99ea-44f4-b719-d64183915e06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "a02403dc-bae3-4b37-994c-c8034e51b276", "address": "fa:16:3e:de:90:ce", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa02403dc-ba", "ovs_interfaceid": "a02403dc-bae3-4b37-994c-c8034e51b276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_vif [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa02403dc-ba, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6e70d47-07fb-4314-89e7-67c6cbdc6b7b) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:19:32 user nova-compute[74739]: INFO os_vif [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:90:ce,bridge_name='br-int',has_traffic_filtering=True,id=a02403dc-bae3-4b37-994c-c8034e51b276,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa02403dc-ba')
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:19:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8ade3-7a95-4e3c-b40f-fa94ea9890bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:19:32 user nova-compute[74739]: No targets found.
Oct 25 18:19:32 user nova-compute[74739]: iSNS:
Oct 25 18:19:32 user nova-compute[74739]: No targets found.
Oct 25 18:19:32 user nova-compute[74739]: STATIC:
Oct 25 18:19:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741
Oct 25 18:19:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:19:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:19:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6
Oct 25 18:19:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:19:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:19:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e
Oct 25 18:19:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:19:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:19:32 user nova-compute[74739]: FIRMWARE:
Oct 25 18:19:32 user nova-compute[74739]: No targets found.
Oct 25 18:19:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:19:32 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:19:32 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdad42a-19a8-44af-9b85-4820567d9e86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7407639-e785-4e51-ba3a-468419ebebfb]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:19:32 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:19:32 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:19:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:19:32 user nova-compute[74739]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:19:32 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:19:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc4de7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7053a7-7737-4bcb-8432-1e914d7c98bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327fe57-7084-4a08-98f6-feb7dcf52f28]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecafd7c-ab6a-4276-b35c-404d620d72e2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ea3f42-2c60-48b1-8cc1-cbd327153d32]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e59116f6', '/dev/disk/by-id/scsi-1SCST_BIOe59116f6-44bd3dbd50900410', '/dev/disk/by-id/scsi-23434626433646264') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f057bf9c-4420-4ed9-994a-180fe1ff69ff]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d074fa9-88e9-46f3-9465-7a8ad2f42f4c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d88d3-ab18-406a-9cfa-a3a9c4911cdd]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]
Oct 25 18:19:32 user nova-compute[74739]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.
Oct 25 18:19:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6758cb6-270b-4836-b873-87480459bde1]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (414ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:19:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Deleting instance files /opt/stack/data/nova/instances/3f6c1c31-99ea-44f4-b719-d64183915e06_del
Oct 25 18:19:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Deletion of /opt/stack/data/nova/instances/3f6c1c31-99ea-44f4-b719-d64183915e06_del complete
Oct 25 18:19:32 user nova-compute[74739]: INFO nova.compute.manager [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:19:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-688e3d29-e01e-427a-bd70-10aa2ad7c9df req-d431fd6d-19a1-4479-a4c3-fe4773c8ad26 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-deleted-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: INFO nova.compute.manager [req-688e3d29-e01e-427a-bd70-10aa2ad7c9df req-d431fd6d-19a1-4479-a4c3-fe4773c8ad26 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Neutron deleted interface a02403dc-bae3-4b37-994c-c8034e51b276; detaching it from the instance and deleting it from the info cache
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-688e3d29-e01e-427a-bd70-10aa2ad7c9df req-d431fd6d-19a1-4479-a4c3-fe4773c8ad26 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-688e3d29-e01e-427a-bd70-10aa2ad7c9df req-d431fd6d-19a1-4479-a4c3-fe4773c8ad26 service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Detach interface failed, port_id=a02403dc-bae3-4b37-994c-c8034e51b276, reason: Instance 3f6c1c31-99ea-44f4-b719-d64183915e06 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:19:33 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Took 0.65 seconds to deallocate network for instance.
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:33 user nova-compute[74739]: WARNING nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state active and task_state deleting.
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:33 user nova-compute[74739]: WARNING nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state active and task_state deleting.
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:33 user nova-compute[74739]: WARNING nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state active and task_state deleting.
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-unplugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Acquiring lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] No waiting events found dispatching network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:33 user nova-compute[74739]: WARNING nova.compute.manager [req-c5c01eea-ec35-4bee-b264-96f291c63e26 req-6739a893-baa3-43f6-88c8-e60dca34aa1a service nova] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Received unexpected event network-vif-plugged-a02403dc-bae3-4b37-994c-c8034e51b276 for instance with vm_state active and task_state deleting.
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:33 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:34 user nova-compute[74739]: INFO nova.compute.manager [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 3f6c1c31-99ea-44f4-b719-d64183915e06] Took 0.83 seconds to detach 1 volumes for instance.
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Error from libvirt while getting description of instance-0000002b: [Error Code 42] Domain not found: no domain with matching uuid '3f6c1c31-99ea-44f4-b719-d64183915e06' (instance-0000002b): libvirt.libvirtError: Domain not found: no domain with matching uuid '3f6c1c31-99ea-44f4-b719-d64183915e06' (instance-0000002b)
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:19:34 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8452MB free_disk=24.908203125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.230s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:34 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance 3f6c1c31-99ea-44f4-b719-d64183915e06
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d5b65593-9f92-46df-b01c-20ee1717a628 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "3f6c1c31-99ea-44f4-b719-d64183915e06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.539s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:19:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:19:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:19:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG nova.compute.manager [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing instance network info cache due to event network-changed-bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Refreshing network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated VIF entry in instance network info cache for port bd5bf9d3-ef73-43ea-8402-52ff583d78c3. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG nova.network.neutron [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-263a04a3-f9b6-4dd0-a065-a3977167086e req-67e69aa0-572f-46ae-9f6d-a79da07de19d service nova] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Stashing vm_state: active {{(pid=74739) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:19:50 user nova-compute[74739]: INFO nova.compute.claims [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Claim successful on node user
Oct 25 18:19:50 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating resource usage from migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-changed-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Refreshing instance network info cache due to event network-changed-518cf5bf-9316-4661-ab79-d40cd6405a99. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.network.neutron [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Refreshing network info cache for port 518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.320s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:50 user nova-compute[74739]: INFO nova.compute.manager [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Migrating
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.network.neutron [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updated VIF entry in instance network info cache for port 518cf5bf-9316-4661-ab79-d40cd6405a99. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.network.neutron [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4709eee2-344f-4a39-933d-97bd79ce837e req-d9434ba3-570d-4212-b855-4b794bb66378 service nova] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:19:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Starting migrate_disk_and_power_off {{(pid=74739) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:51 user nova-compute[74739]: WARNING nova.compute.manager [req-e7f00bf3-e411-42c1-a5cc-eb78e3eff3b4 req-e6cf8836-9ba1-41e0-b444-6e2190af393f service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state resize_migrating.
Oct 25 18:19:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance destroyed successfully.
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:19:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap518cf5bf-93, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19c430b3-8742-48eb-8600-481995e35eb2) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:19:52 user nova-compute[74739]: INFO os_vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93')
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:19:52 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c753f77-7f68-48e5-8909-c310f66854c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:19:52 user nova-compute[74739]: No targets found.
Oct 25 18:19:52 user nova-compute[74739]: iSNS:
Oct 25 18:19:52 user nova-compute[74739]: No targets found.
Oct 25 18:19:52 user nova-compute[74739]: STATIC:
Oct 25 18:19:52 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741
Oct 25 18:19:52 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:19:52 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:19:52 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6
Oct 25 18:19:52 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:19:52 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:19:52 user nova-compute[74739]: FIRMWARE:
Oct 25 18:19:52 user nova-compute[74739]: No targets found.
Oct 25 18:19:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:19:52 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:19:52 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[044c3fe4-4da4-4158-be2a-d2042a192e68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ab392-a615-4de7-bffe-b87178a40a24]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:19:52 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:19:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:19:52 user nova-compute[74739]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:19:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec408790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8609a8-f0ca-4e81-8332-8d29d38db1c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8dd8d4-ba86-45a0-90d5-7be126fd693b]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f9327-e66e-4dea-a565-e3d293994de2]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55434a-6dda-4efa-b8c1-ea9e59a25022]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb17b0ee3-3101bb51c391ed15', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b17b0ee3', '/dev/disk/by-id/scsi-23331303162623531') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[74318705-132e-4ae7-937f-e79183534ffb]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6a3e3-c478-4f08-8d6e-6f6f22a14785]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13b9fa-a094-4a1c-a543-584536f82e11]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]
Oct 25 18:19:52 user nova-compute[74739]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.
Oct 25 18:19:52 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[764cae96-2590-4c41-a961-2addcb3ae610]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== disconnect_volume: return (307ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:19:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Port 518cf5bf-9316-4661-ab79-d40cd6405a99 binding to destination host user is already ACTIVE {{(pid=74739) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:19:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:19:53 user nova-compute[74739]: WARNING nova.compute.manager [req-54ddfa03-2a21-4c2a-bccc-3a5501da3448 req-482fc125-c9da-49fb-88a5-670096dff0e6 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state resize_migrated.
Oct 25 18:19:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.utils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2078b0d-c667-4b1d-a5cb-1e27a6203dc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[77637bde-a4aa-468a-8132-8d4c5157a49e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72e7b0f-78ac-45be-87ad-ec52d82f42a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6907f1-04ab-47db-9739-09cd6bdf424c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:19:54 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:19:54 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3165c-356a-4a46-a758-3e29f9d8f491]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:19:54 user nova-compute[74739]: DEBUG os_brick.utils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:19:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Starting finish_migration {{(pid=74739) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance directory exists: not creating {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 25 18:20:10 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Creating image(s)
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Ensure instance console log exists: /opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start _get_guest_xml network_info=[{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': 'd16318da-c671-49dd-bfb1-c52aa4218a70', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b1be4b31-34e2-4e28-a9af-e928087a34c3', 'attached_at': '2023-10-25T18:20:11.000000', 'detached_at': '', 'volume_id': '01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'serial': '01b3d884-5cd5-4f05-a7e9-8c34958363c6'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:20:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:10 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:20:10 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:20:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:20:10 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:20:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:20:10 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:10 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dcb0bb-947c-41d9-b280-4b7030c030eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:20:11 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81f8c9-cd76-4866-86cc-3c0066e897b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6] added
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15ef92f-a6fa-40e1-af5e-e275106b45ab]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbac9bd4-d6dc-417e-a427-57cc6286dede]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjdmyFZB {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjdmyFZB" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b5a83-8425-40ad-a5ad-fd419a94f7f5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjdmyFZB'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e206a27-dddd-46a0-aa47-32ba37c10d30]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9d59ae-c55a-4cef-96df-42589eca8473]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[47482e5a-dd5e-469c-b4a0-bfa7721cc0e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]
Oct 25 18:20:11 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ed161a-7880-4a39-8f58-ab9735f0f654]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4ee8b-216a-4391-8590-5ec94cee9b39]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:11 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe125b5c-6666-4618-a754-2f4f3e1e0a04]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:20:11 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23331303162623531', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331303162623531', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:20:12 user nova-compute[74739]:   <uuid>b1be4b31-34e2-4e28-a9af-e928087a34c3</uuid>
Oct 25 18:20:12 user nova-compute[74739]:   <name>instance-0000002c</name>
Oct 25 18:20:12 user nova-compute[74739]:   <memory>2097152</memory>
Oct 25 18:20:12 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:20:12 user nova-compute[74739]:   <metadata>
Oct 25 18:20:12 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:20:12 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:20:12 user nova-compute[74739]:       <nova:name>tempest-ServerActionsTestOtherA-server-761348612</nova:name>
Oct 25 18:20:12 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:20:10</nova:creationTime>
Oct 25 18:20:12 user nova-compute[74739]:       <nova:flavor name="m1.small">
Oct 25 18:20:12 user nova-compute[74739]:         <nova:memory>2048</nova:memory>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:disk>20</nova:disk>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:20:12 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:20:12 user nova-compute[74739]:       <nova:owner>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:user uuid="b0a42eef8b354d4fad0b4eb277270cb4">tempest-ServerActionsTestOtherA-1860404749-project-member</nova:user>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:project uuid="ee2286f0b19a436897ed0d9c42991e06">tempest-ServerActionsTestOtherA-1860404749</nova:project>
Oct 25 18:20:12 user nova-compute[74739]:       </nova:owner>
Oct 25 18:20:12 user nova-compute[74739]:       <nova:ports>
Oct 25 18:20:12 user nova-compute[74739]:         <nova:port uuid="518cf5bf-9316-4661-ab79-d40cd6405a99">
Oct 25 18:20:12 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 25 18:20:12 user nova-compute[74739]:         </nova:port>
Oct 25 18:20:12 user nova-compute[74739]:       </nova:ports>
Oct 25 18:20:12 user nova-compute[74739]:     </nova:instance>
Oct 25 18:20:12 user nova-compute[74739]:   </metadata>
Oct 25 18:20:12 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:20:12 user nova-compute[74739]:     <system>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="serial">b1be4b31-34e2-4e28-a9af-e928087a34c3</entry>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="uuid">b1be4b31-34e2-4e28-a9af-e928087a34c3</entry>
Oct 25 18:20:12 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:20:12 user nova-compute[74739]:     </system>
Oct 25 18:20:12 user nova-compute[74739]:   </sysinfo>
Oct 25 18:20:12 user nova-compute[74739]:   <os>
Oct 25 18:20:12 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:20:12 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:20:12 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:20:12 user nova-compute[74739]:   </os>
Oct 25 18:20:12 user nova-compute[74739]:   <features>
Oct 25 18:20:12 user nova-compute[74739]:     <acpi/>
Oct 25 18:20:12 user nova-compute[74739]:     <apic/>
Oct 25 18:20:12 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:20:12 user nova-compute[74739]:   </features>
Oct 25 18:20:12 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:20:12 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:20:12 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:20:12 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:20:12 user nova-compute[74739]:   </clock>
Oct 25 18:20:12 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:20:12 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:20:12 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:20:12 user nova-compute[74739]:   </cpu>
Oct 25 18:20:12 user nova-compute[74739]:   <devices>
Oct 25 18:20:12 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:20:12 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:20:12 user nova-compute[74739]:       <source dev="/dev/sdb"/>
Oct 25 18:20:12 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:20:12 user nova-compute[74739]:       <serial>01b3d884-5cd5-4f05-a7e9-8c34958363c6</serial>
Oct 25 18:20:12 user nova-compute[74739]:     </disk>
Oct 25 18:20:12 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:20:12 user nova-compute[74739]:       <mac address="fa:16:3e:64:df:81"/>
Oct 25 18:20:12 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:20:12 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:20:12 user nova-compute[74739]:       <target dev="tap518cf5bf-93"/>
Oct 25 18:20:12 user nova-compute[74739]:     </interface>
Oct 25 18:20:12 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:20:12 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3/console.log" append="off"/>
Oct 25 18:20:12 user nova-compute[74739]:     </serial>
Oct 25 18:20:12 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:20:12 user nova-compute[74739]:     <video>
Oct 25 18:20:12 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:20:12 user nova-compute[74739]:     </video>
Oct 25 18:20:12 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:20:12 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:20:12 user nova-compute[74739]:     </rng>
Oct 25 18:20:12 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:20:12 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:20:12 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:20:12 user nova-compute[74739]:     </memballoon>
Oct 25 18:20:12 user nova-compute[74739]:   </devices>
Oct 25 18:20:12 user nova-compute[74739]: </domain>
Oct 25 18:20:12 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:18:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:19:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-50273171-network", "vif_mac": "fa:16:3e:64:df:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG os_vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2db0b9b-0739-52fe-9dae-b3b47b832436', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap518cf5bf-93, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap518cf5bf-93, col_values=(('qos', UUID('93461144-8cc9-4f9e-8d75-34a0991d03b7')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap518cf5bf-93, col_values=(('external_ids', {'iface-id': '518cf5bf-9316-4661-ab79-d40cd6405a99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:df:81', 'vm-uuid': 'b1be4b31-34e2-4e28-a9af-e928087a34c3'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:12 user nova-compute[74739]: INFO os_vif [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93')
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:20:12 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] No VIF found with MAC fa:16:3e:64:df:81, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG nova.compute.manager [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:13 user nova-compute[74739]: WARNING nova.compute.manager [req-f53c3b44-015d-4e01-92da-ddee04faacb0 req-dba6822d-09a6-4e22-871a-1b104cc423a8 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state resize_finish.
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:20:15 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance running successfully.
Oct 25 18:20:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Failed to set time: agent not configured {{(pid=74739) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5c47df87-17ed-495b-b028-5035bb439f2f tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] finish_migration finished successfully. {{(pid=74739) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:15 user nova-compute[74739]: DEBUG nova.compute.manager [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:15 user nova-compute[74739]: WARNING nova.compute.manager [req-6b9fd573-003a-4366-98a8-1655e71c0c26 req-b6ce4f02-c764-4dd5-9a0f-a0e0c73cdeb4 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state resize_finish.
Oct 25 18:20:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:20:22 user nova-compute[74739]: INFO nova.compute.claims [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Claim successful on node user
Oct 25 18:20:22 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:20:22 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:20:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.policy [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:20:23 user nova-compute[74739]: INFO nova.virt.block_device [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Booting with volume 5df8714f-b7b9-405b-8333-201b45635d5e at /dev/vda
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.utils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf2285-35f7-448d-be97-385043aada7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9ea1e-8b08-4bb3-b82d-125deb0c0c21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[698340d5-fc5b-4532-b9fe-d199d114b7c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e93ce6e-fd87-4bdb-bba3-d91df4ab80de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:20:23 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb199c7-9975-403d-ac04-078ac4eb6492]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG os_brick.utils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating existing volume attachment record: 6fd98df1-0b7f-4078-be93-69e77adc8a5a {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Successfully created port: e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:20:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Skipping network cache update for instance because it is Building. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Successfully updated port: e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-changed-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing instance network info cache due to event network-changed-e529988a-400c-49cf-87fb-c551ca24318b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] Acquiring lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:20:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating instance_info_cache with network_info: [{"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance network_info: |[{"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] Acquired lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG nova.network.neutron [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing network info cache for port e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG nova.network.neutron [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updated VIF entry in instance network info cache for port e529988a-400c-49cf-87fb-c551ca24318b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG nova.network.neutron [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating instance_info_cache with network_info: [{"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:20:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a204b39c-99a4-4f15-a534-527e9e4c5e72 req-1e060833-f3fb-4c92-b1eb-badac2747d5e service nova] Releasing lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:20:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:20:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:20:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=24.90591812133789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Applying migration context for instance b1be4b31-34e2-4e28-a9af-e928087a34c3 as it has an incoming, in-progress migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8. Migration status is finished {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 18:20:36 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating resource usage from migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:20:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:20:40 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Creating image(s)
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Ensure instance console log exists: /opt/stack/data/nova/instances/7e376d96-8f5e-4064-a9ee-c02985c43ae2/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Start _get_guest_xml network_info=[{"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '6fd98df1-0b7f-4078-be93-69e77adc8a5a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e376d96-8f5e-4064-a9ee-c02985c43ae2', 'attached_at': '', 'detached_at': '', 'volume_id': '5df8714f-b7b9-405b-8333-201b45635d5e', 'serial': '5df8714f-b7b9-405b-8333-201b45635d5e'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:20:40 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:40 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:20:40 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:20:40 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:20:40 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a01e5-1356-49c1-a709-d49ab43ff097]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:20:40 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[657ded38-b6e1-4545-b21f-01330d5891f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e] added
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46eccb0-54fc-489f-acc2-61064ee6a36c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c386c750-d80e-41f8-9687-ae1df0effaec]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPqjJTBc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPqjJTBc" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c317d-6a65-4cd4-b8e1-f03b95c2e050]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPqjJTBc'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd230489-3449-42dc-ae9d-d6059ee87737]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fd0dac-9297-4748-a5be-873bb46d209c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ccb76d-58e2-41c8-9586-9d6810539afe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]
Oct 25 18:20:40 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9921ba6d-2fe2-468a-86b2-bf7f88e29526]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aaaf5d-e991-45b5-ba48-1d26204df036]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:20:40 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:20:40 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547fcf3-741b-48e1-9901-cf2ff89809e9]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:20:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23434626433646264', 'path': '/dev/sdc'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434626433646264', 'path': '/dev/sdc'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1693841581',display_name='tempest-TestVolumeBootPattern-server-1693841581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1693841581',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-tf5xcf94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:20:23Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=7e376d96-8f5e-4064-a9ee-c02985c43ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.objects.instance [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e376d96-8f5e-4064-a9ee-c02985c43ae2 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:20:41 user nova-compute[74739]:   <uuid>7e376d96-8f5e-4064-a9ee-c02985c43ae2</uuid>
Oct 25 18:20:41 user nova-compute[74739]:   <name>instance-0000002d</name>
Oct 25 18:20:41 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:20:41 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:20:41 user nova-compute[74739]:   <metadata>
Oct 25 18:20:41 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:20:41 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:20:41 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-server-1693841581</nova:name>
Oct 25 18:20:41 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:20:40</nova:creationTime>
Oct 25 18:20:41 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:20:41 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:20:41 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:20:41 user nova-compute[74739]:       <nova:owner>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:20:41 user nova-compute[74739]:       </nova:owner>
Oct 25 18:20:41 user nova-compute[74739]:       <nova:ports>
Oct 25 18:20:41 user nova-compute[74739]:         <nova:port uuid="e529988a-400c-49cf-87fb-c551ca24318b">
Oct 25 18:20:41 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 25 18:20:41 user nova-compute[74739]:         </nova:port>
Oct 25 18:20:41 user nova-compute[74739]:       </nova:ports>
Oct 25 18:20:41 user nova-compute[74739]:     </nova:instance>
Oct 25 18:20:41 user nova-compute[74739]:   </metadata>
Oct 25 18:20:41 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:20:41 user nova-compute[74739]:     <system>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="serial">7e376d96-8f5e-4064-a9ee-c02985c43ae2</entry>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="uuid">7e376d96-8f5e-4064-a9ee-c02985c43ae2</entry>
Oct 25 18:20:41 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:20:41 user nova-compute[74739]:     </system>
Oct 25 18:20:41 user nova-compute[74739]:   </sysinfo>
Oct 25 18:20:41 user nova-compute[74739]:   <os>
Oct 25 18:20:41 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:20:41 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:20:41 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:20:41 user nova-compute[74739]:   </os>
Oct 25 18:20:41 user nova-compute[74739]:   <features>
Oct 25 18:20:41 user nova-compute[74739]:     <acpi/>
Oct 25 18:20:41 user nova-compute[74739]:     <apic/>
Oct 25 18:20:41 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:20:41 user nova-compute[74739]:   </features>
Oct 25 18:20:41 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:20:41 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:20:41 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:20:41 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:20:41 user nova-compute[74739]:   </clock>
Oct 25 18:20:41 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:20:41 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:20:41 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:20:41 user nova-compute[74739]:   </cpu>
Oct 25 18:20:41 user nova-compute[74739]:   <devices>
Oct 25 18:20:41 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:20:41 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:20:41 user nova-compute[74739]:       <source dev="/dev/sdc"/>
Oct 25 18:20:41 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:20:41 user nova-compute[74739]:       <serial>5df8714f-b7b9-405b-8333-201b45635d5e</serial>
Oct 25 18:20:41 user nova-compute[74739]:     </disk>
Oct 25 18:20:41 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:20:41 user nova-compute[74739]:       <mac address="fa:16:3e:0b:37:08"/>
Oct 25 18:20:41 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:20:41 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:20:41 user nova-compute[74739]:       <target dev="tape529988a-40"/>
Oct 25 18:20:41 user nova-compute[74739]:     </interface>
Oct 25 18:20:41 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:20:41 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/7e376d96-8f5e-4064-a9ee-c02985c43ae2/console.log" append="off"/>
Oct 25 18:20:41 user nova-compute[74739]:     </serial>
Oct 25 18:20:41 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:20:41 user nova-compute[74739]:     <video>
Oct 25 18:20:41 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:20:41 user nova-compute[74739]:     </video>
Oct 25 18:20:41 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:20:41 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:20:41 user nova-compute[74739]:     </rng>
Oct 25 18:20:41 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:20:41 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:20:41 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:20:41 user nova-compute[74739]:     </memballoon>
Oct 25 18:20:41 user nova-compute[74739]:   </devices>
Oct 25 18:20:41 user nova-compute[74739]: </domain>
Oct 25 18:20:41 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1693841581',display_name='tempest-TestVolumeBootPattern-server-1693841581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1693841581',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-tf5xcf94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:20:23Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=7e376d96-8f5e-4064-a9ee-c02985c43ae2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG os_vif [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c817745d-d234-594c-a6b6-117e127f9dd3', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape529988a-40, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape529988a-40, col_values=(('qos', UUID('4b240542-a3ff-48ec-9a9b-b516257c6354')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape529988a-40, col_values=(('external_ids', {'iface-id': 'e529988a-400c-49cf-87fb-c551ca24318b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:37:08', 'vm-uuid': '7e376d96-8f5e-4064-a9ee-c02985c43ae2'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:41 user nova-compute[74739]: INFO os_vif [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40')
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:20:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:0b:37:08, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] No waiting events found dispatching network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:43 user nova-compute[74739]: WARNING nova.compute.manager [req-8960b710-4417-4a71-89c9-f1638a21dadf req-1a0cfebc-e84b-4072-a7a4-f008da562410 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received unexpected event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b for instance with vm_state building and task_state spawning.
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:20:45 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance spawned successfully.
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:20:45 user nova-compute[74739]: INFO nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:20:45 user nova-compute[74739]: INFO nova.compute.manager [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Took 22.68 seconds to build instance.
Oct 25 18:20:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-13f1a6b5-6317-4273-a6f6-62b7ccc78c13 tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.775s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] No waiting events found dispatching network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:45 user nova-compute[74739]: WARNING nova.compute.manager [req-0c111e42-506d-437e-b455-6da80a7e45d8 req-4d424ebb-1d92-44d6-be81-ebb8ccab1151 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received unexpected event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b for instance with vm_state active and task_state None.
Oct 25 18:20:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:46 user nova-compute[74739]: INFO nova.compute.manager [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Unrescuing
Oct 25 18:20:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:20:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:20:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:20:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG nova.objects.instance [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'flavor' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG nova.compute.manager [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:47 user nova-compute[74739]: WARNING nova.compute.manager [req-76742c22-db61-4996-a2f5-eea5d26c9f52 req-d832935b-817e-4c80-9fef-efb65c008b99 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:20:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:47 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance destroyed successfully.
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:49 user nova-compute[74739]: WARNING nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:20:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:49 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:49 user nova-compute[74739]: WARNING nova.compute.manager [req-dd3f93a9-143a-4839-82b1-46bf790aba5f req-39da9864-8b77-4059-a035-f2fd0d1cfff2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state rescued and task_state unrescuing.
Oct 25 18:20:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG nova.compute.manager [None req-03b67704-8233-45a8-b9f0-97800cd5e212 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:20:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:20:51 user nova-compute[74739]: WARNING nova.compute.manager [req-1c8886ca-1a1f-447a-8e9b-56719ee57984 req-1737360b-647a-49ea-8eb7-78e7feeed2c2 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state active and task_state None.
Oct 25 18:20:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:20:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:21:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:21:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:21:23 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:21:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [{"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:21:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-5eea09f6-2a67-47d3-ba47-356a73a68b67" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:21:24 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:21:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:21:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:21:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:21:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:21:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:21:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:21:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=24.903854370117188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Applying migration context for instance b1be4b31-34e2-4e28-a9af-e928087a34c3 as it has an incoming, in-progress migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8. Migration status is finished {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 25 18:21:36 user nova-compute[74739]: INFO nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating resource usage from migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:21:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Going to confirm migration 2 {{(pid=74739) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:21:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'info_cache' on Instance uuid b1be4b31-34e2-4e28-a9af-e928087a34c3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG nova.objects.instance [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'migration_context' on Instance uuid b1be4b31-34e2-4e28-a9af-e928087a34c3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG nova.objects.base [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Object Instance<b1be4b31-34e2-4e28-a9af-e928087a34c3> lazy-loaded attributes: info_cache,migration_context {{(pid=74739) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:21:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.301s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:21:40 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Deleted allocation for migration 2d394cbc-869a-4296-a4d2-02fe9915b2d8
Oct 25 18:21:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-08d5ec9e-f9e1-4aee-957d-03701d5a4fd6 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.198s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:21:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:21:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:21:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:21:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:21:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-changed-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG nova.compute.manager [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing instance network info cache due to event network-changed-e529988a-400c-49cf-87fb-c551ca24318b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] Acquiring lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] Acquired lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG nova.network.neutron [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing network info cache for port e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG nova.network.neutron [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updated VIF entry in instance network info cache for port e529988a-400c-49cf-87fb-c551ca24318b. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG nova.network.neutron [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating instance_info_cache with network_info: [{"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:14 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-70983f4c-56fd-41a2-aa5a-fbfec463e63e req-0d6df36d-9cd3-4adf-94b0-f47347fe65a9 service nova] Releasing lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:24 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:24 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:22:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:24 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:22:25 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [{"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:29 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:22:29 user nova-compute[74739]: INFO nova.compute.claims [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Claim successful on node user
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:22:30 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.policy [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ad7394ee72341c7b091dc93d9c919e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bfa536399c34f8d8321bf6f69ef0cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:22:30 user nova-compute[74739]: INFO nova.virt.block_device [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Booting with volume b6e98ef2-7764-4797-a819-d67d321fe52f at /dev/vda
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bd134-b4cd-4a92-8788-f48ea11bbf5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967d374-5787-46f3-938e-3059022edc27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2c778a-a570-4697-b8c4-04c00971ef67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa0c54a-325a-443e-a085-c98ae6fe1623]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:22:30 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:22:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0eb244-3de4-429d-b312-20df6a1156a2]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating existing volume attachment record: 92264228-dc9c-44c2-a801-d03029e4da76 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:22:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Successfully created port: ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Successfully updated port: ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquired lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing instance network info cache due to event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] Acquiring lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating instance_info_cache with network_info: [{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Releasing lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Instance network_info: |[{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] Acquired lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:31 user nova-compute[74739]: DEBUG nova.network.neutron [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:22:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updated VIF entry in instance network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:22:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating instance_info_cache with network_info: [{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a2a19888-83ac-48c1-8f73-864b99327c98 req-f64f5f5b-a2ee-4224-b56e-43cc2f59ef0f service nova] Releasing lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:32 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:33 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:22:36 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=24.902568817138672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bb15516e-f44b-456d-84e2-5de0c8f1e869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:22:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing instance network info cache due to event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updated VIF entry in instance network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.network.neutron [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d4dfd2cc-5a98-48b7-a6e5-3d41eb73535a req-d6e687b1-9ad7-451c-aef4-ff8fca0f74bd service nova] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:38 user nova-compute[74739]: INFO nova.compute.manager [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Detaching volume e4c4d91f-3129-4221-95bf-e33cae717741
Oct 25 18:22:38 user nova-compute[74739]: INFO nova.virt.block_device [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Attempting to driver detach volume e4c4d91f-3129-4221-95bf-e33cae717741 from mountpoint /dev/vdb
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Attempting to detach device vdb from instance 3cdbde0e-91ef-412c-b08e-0b5f815feada from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:22:38 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:22:38 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:22:38 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:22:38 user nova-compute[74739]:   <serial>e4c4d91f-3129-4221-95bf-e33cae717741</serial>
Oct 25 18:22:38 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:22:38 user nova-compute[74739]: </disk>
Oct 25 18:22:38 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:22:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully detached device vdb from instance 3cdbde0e-91ef-412c-b08e-0b5f815feada from the persistent domain config.
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cdbde0e-91ef-412c-b08e-0b5f815feada from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:22:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:22:38 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:22:38 user nova-compute[74739]:   <source dev="/dev/sdd"/>
Oct 25 18:22:38 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:22:38 user nova-compute[74739]:   <serial>e4c4d91f-3129-4221-95bf-e33cae717741</serial>
Oct 25 18:22:38 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:22:38 user nova-compute[74739]: </disk>
Oct 25 18:22:38 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:22:39 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing instance network info cache due to event network-changed-f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Refreshing network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updated VIF entry in instance network info cache for port f3c07012-c3a5-4828-b7e6-c16c56e2a120. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG nova.network.neutron [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-cc94955e-43c3-47fd-94d4-2bb17354e63e req-b17e3cc4-bf7d-4707-8c8e-13ee87d7129e service nova] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:22:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:22:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:22:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Creating image(s)
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Did not create local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Ensure instance console log exists: /opt/stack/data/nova/instances/bb15516e-f44b-456d-84e2-5de0c8f1e869/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Start _get_guest_xml network_info=[{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'attachment_id': '92264228-dc9c-44c2-a801-d03029e4da76', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmrjLBUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb15516e-f44b-456d-84e2-5de0c8f1e869', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6e98ef2-7764-4797-a819-d67d321fe52f', 'serial': 'b6e98ef2-7764-4797-a819-d67d321fe52f'}, 'boot_index': 0, 'volume_type': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:22:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:22:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmrjLBUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:22:48 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:22:48 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:22:48 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0756b6-c28c-44a9-afb2-d1f8df7f596c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:22:48 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f88fb6-1027-4f2a-a3e3-55652a809863]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f] added
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966db2e-cffd-4960-baab-98707bf1bdce]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30728d0-4cc2-4883-b801-2be51a4cf3d3]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmrjLBUg {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmrjLBUg" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[55516232-362e-4c99-831f-5294e7b38a3c]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmrjLBUg'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d781e-ab94-4ac7-958d-582a2ca1bdc7]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a5b65-3f56-4fbf-83f9-67c13176bd2e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb38432-9b68-4c13-807f-709970d6c5c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260]
Oct 25 18:22:48 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260] successful.
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd3e2f0-8937-44b8-a2bd-67154bf6ed74]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e234008-bfdd-402a-a49f-af11aa09f747]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:48 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:22:48 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f1c478-73db-4155-8474-d487e5c527b2]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:22:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmrjLBUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23939383836333337', 'path': '/dev/sde'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939383836333337', 'path': '/dev/sde'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:22:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1697552087',display_name='tempest-TestVolumeBootPattern-server-1697552087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1697552087',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-jbi9eadh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:22:30Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=bb15516e-f44b-456d-84e2-5de0c8f1e869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'pci_devices' on Instance uuid bb15516e-f44b-456d-84e2-5de0c8f1e869 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:22:49 user nova-compute[74739]:   <uuid>bb15516e-f44b-456d-84e2-5de0c8f1e869</uuid>
Oct 25 18:22:49 user nova-compute[74739]:   <name>instance-0000002e</name>
Oct 25 18:22:49 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:22:49 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:22:49 user nova-compute[74739]:   <metadata>
Oct 25 18:22:49 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:22:49 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:22:49 user nova-compute[74739]:       <nova:name>tempest-TestVolumeBootPattern-server-1697552087</nova:name>
Oct 25 18:22:49 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:22:48</nova:creationTime>
Oct 25 18:22:49 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:22:49 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:22:49 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:22:49 user nova-compute[74739]:       <nova:owner>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:user uuid="4ad7394ee72341c7b091dc93d9c919e2">tempest-TestVolumeBootPattern-2117961967-project-member</nova:user>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:project uuid="6bfa536399c34f8d8321bf6f69ef0cd6">tempest-TestVolumeBootPattern-2117961967</nova:project>
Oct 25 18:22:49 user nova-compute[74739]:       </nova:owner>
Oct 25 18:22:49 user nova-compute[74739]:       <nova:ports>
Oct 25 18:22:49 user nova-compute[74739]:         <nova:port uuid="ffb278ac-6163-4a9a-96bb-5a3b32a62bfb">
Oct 25 18:22:49 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 25 18:22:49 user nova-compute[74739]:         </nova:port>
Oct 25 18:22:49 user nova-compute[74739]:       </nova:ports>
Oct 25 18:22:49 user nova-compute[74739]:     </nova:instance>
Oct 25 18:22:49 user nova-compute[74739]:   </metadata>
Oct 25 18:22:49 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:22:49 user nova-compute[74739]:     <system>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="serial">bb15516e-f44b-456d-84e2-5de0c8f1e869</entry>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="uuid">bb15516e-f44b-456d-84e2-5de0c8f1e869</entry>
Oct 25 18:22:49 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:22:49 user nova-compute[74739]:     </system>
Oct 25 18:22:49 user nova-compute[74739]:   </sysinfo>
Oct 25 18:22:49 user nova-compute[74739]:   <os>
Oct 25 18:22:49 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:22:49 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:22:49 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:22:49 user nova-compute[74739]:   </os>
Oct 25 18:22:49 user nova-compute[74739]:   <features>
Oct 25 18:22:49 user nova-compute[74739]:     <acpi/>
Oct 25 18:22:49 user nova-compute[74739]:     <apic/>
Oct 25 18:22:49 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:22:49 user nova-compute[74739]:   </features>
Oct 25 18:22:49 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:22:49 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:22:49 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:22:49 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:22:49 user nova-compute[74739]:   </clock>
Oct 25 18:22:49 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:22:49 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:22:49 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:22:49 user nova-compute[74739]:   </cpu>
Oct 25 18:22:49 user nova-compute[74739]:   <devices>
Oct 25 18:22:49 user nova-compute[74739]:     <disk type="block" device="disk">
Oct 25 18:22:49 user nova-compute[74739]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:22:49 user nova-compute[74739]:       <source dev="/dev/sde"/>
Oct 25 18:22:49 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:22:49 user nova-compute[74739]:       <serial>b6e98ef2-7764-4797-a819-d67d321fe52f</serial>
Oct 25 18:22:49 user nova-compute[74739]:     </disk>
Oct 25 18:22:49 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:22:49 user nova-compute[74739]:       <mac address="fa:16:3e:2b:80:e8"/>
Oct 25 18:22:49 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:22:49 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:22:49 user nova-compute[74739]:       <target dev="tapffb278ac-61"/>
Oct 25 18:22:49 user nova-compute[74739]:     </interface>
Oct 25 18:22:49 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:22:49 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/bb15516e-f44b-456d-84e2-5de0c8f1e869/console.log" append="off"/>
Oct 25 18:22:49 user nova-compute[74739]:     </serial>
Oct 25 18:22:49 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:22:49 user nova-compute[74739]:     <video>
Oct 25 18:22:49 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:22:49 user nova-compute[74739]:     </video>
Oct 25 18:22:49 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:22:49 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:22:49 user nova-compute[74739]:     </rng>
Oct 25 18:22:49 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:22:49 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:22:49 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:22:49 user nova-compute[74739]:     </memballoon>
Oct 25 18:22:49 user nova-compute[74739]:   </devices>
Oct 25 18:22:49 user nova-compute[74739]: </domain>
Oct 25 18:22:49 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:22:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1697552087',display_name='tempest-TestVolumeBootPattern-server-1697552087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1697552087',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-jbi9eadh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:22:30Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=bb15516e-f44b-456d-84e2-5de0c8f1e869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG os_vif [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a5f21de-7c70-5d5d-a5d3-af58d64b8af2', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffb278ac-61, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffb278ac-61, col_values=(('qos', UUID('e71f102e-29bd-4449-a165-0d2b62f23a59')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffb278ac-61, col_values=(('external_ids', {'iface-id': 'ffb278ac-6163-4a9a-96bb-5a3b32a62bfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:80:e8', 'vm-uuid': 'bb15516e-f44b-456d-84e2-5de0c8f1e869'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:49 user nova-compute[74739]: INFO os_vif [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61')
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:22:49 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] No VIF found with MAC fa:16:3e:2b:80:e8, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:22:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:51 user nova-compute[74739]: DEBUG nova.compute.manager [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] No waiting events found dispatching network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:22:51 user nova-compute[74739]: WARNING nova.compute.manager [req-95914f2f-1d8e-49b4-a43d-e888520d20e8 req-7ec8b008-1996-4fb8-85b8-53f932810d13 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received unexpected event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb for instance with vm_state building and task_state spawning.
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:22:52 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Instance spawned successfully.
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:22:52 user nova-compute[74739]: INFO nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Took 4.87 seconds to spawn the instance on the hypervisor.
Oct 25 18:22:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:22:53 user nova-compute[74739]: INFO nova.compute.manager [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Took 23.13 seconds to build instance.
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1177fbc3-989e-4766-8741-f2111275259f tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.237s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG nova.compute.manager [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] No waiting events found dispatching network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:22:53 user nova-compute[74739]: WARNING nova.compute.manager [req-7bc66ced-e5e9-434c-a312-61174527a504 req-82cc9ad7-e939-4702-a602-37e7c5cbb8ba service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received unexpected event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb for instance with vm_state active and task_state None.
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:22:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.011s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Verify base images {{(pid=74739) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74739) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Image id fa4bc56a-56a0-4e07-993a-3918bd5a9269 yields fingerprint 6d09e7f0f4eabdb040d73d57e085236968f7d880 {{(pid=74739) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] image fa4bc56a-56a0-4e07-993a-3918bd5a9269 at (/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880): checking
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] image fa4bc56a-56a0-4e07-993a-3918bd5a9269 at (/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880): image is in use {{(pid=74739) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] 3cdbde0e-91ef-412c-b08e-0b5f815feada is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] 3cdbde0e-91ef-412c-b08e-0b5f815feada has a disk file {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 3cdbde0e-91ef-412c-b08e-0b5f815feada is backed by 6d09e7f0f4eabdb040d73d57e085236968f7d880 {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] 7e376d96-8f5e-4064-a9ee-c02985c43ae2 is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] bb15516e-f44b-456d-84e2-5de0c8f1e869 is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] 5eea09f6-2a67-47d3-ba47-356a73a68b67 is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] 5eea09f6-2a67-47d3-ba47-356a73a68b67 has a disk file {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 is backed by 6d09e7f0f4eabdb040d73d57e085236968f7d880 {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] b1be4b31-34e2-4e28-a9af-e928087a34c3 is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] c5e5321b-04b9-40b9-8038-9f85cf4daf7e is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] c5e5321b-04b9-40b9-8038-9f85cf4daf7e has a disk file {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e is backed by 6d09e7f0f4eabdb040d73d57e085236968f7d880 {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 is a valid instance name {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 has a disk file {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 is backed by 6d09e7f0f4eabdb040d73d57e085236968f7d880 {{(pid=74739) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6
Oct 25 18:22:54 user nova-compute[74739]: WARNING nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Active base files: /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Removable base files: /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1 /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582 /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889 /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3 /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6 /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/11c7da13b703f40f719f9e2ec402d264ffbb8c2f
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cf581a1dcecc0f7168458f35c7108bc54812b8d1
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a845e1d88f76ba88fbe8c575e654dfa7388ff59a
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/218114d20fc3ee387536a5331e30bc440c36d582
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3227b334ba5dd78009b3df0b44dfd345211c889
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/81058356e1af6248a1d161af93a902556dda2ac3
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/33ac72c090c51a35b4f67dd8291e8104d6690eba
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/84becd47b1a6c7fe667dcf41d96c90e38f5831f6
Oct 25 18:22:54 user nova-compute[74739]: INFO nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3349462cf9293c9e30a7b193df55a8845c733899
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Verification complete {{(pid=74739) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Verify swap images {{(pid=74739) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 25 18:22:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.imagecache [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Verify ephemeral images {{(pid=74739) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 25 18:22:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:59 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cdbde0e-91ef-412c-b08e-0b5f815feada is timed out.
Oct 25 18:22:59 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully detached device vdb from instance 3cdbde0e-91ef-412c-b08e-0b5f815feada from the live domain config.
Oct 25 18:22:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MIzVgLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:22:59 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a85de-9754-4263-9094-997319749ad4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:22:59 user nova-compute[74739]: No targets found.
Oct 25 18:22:59 user nova-compute[74739]: iSNS:
Oct 25 18:22:59 user nova-compute[74739]: No targets found.
Oct 25 18:22:59 user nova-compute[74739]: STATIC:
Oct 25 18:22:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f
Oct 25 18:22:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:22:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:22:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741
Oct 25 18:22:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:22:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:22:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6
Oct 25 18:22:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:22:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:22:59 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e
Oct 25 18:22:59 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:22:59 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:22:59 user nova-compute[74739]: FIRMWARE:
Oct 25 18:22:59 user nova-compute[74739]: No targets found.
Oct 25 18:22:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:22:59 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:22:59 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea0fe5a-72c3-4aed-917f-265aa70d8d5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbfe268-aad4-4bcd-8f0d-821d632eeea2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:22:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:22:59 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:22:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc1ebac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741'): ({'sdd'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Removing single pathed devices sdd {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab092efb-ceef-4bc9-88f2-7643b716631f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efdf3fc-057b-4262-8590-b1f01322741d]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Flushing IO for device /dev/sdd {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[725cd44e-f8ed-475c-8c18-bfc97f287e5b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7d6ab1-404e-4e2a-bf15-52676f2ca990]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] SCSI volumes sdd have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e16670-b382-43b8-a319-fd05e6def1bd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[06459b34-47fc-42ff-875c-9975cb737885]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260]
Oct 25 18:22:59 user nova-compute[74739]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741, portal: 172.16.0.220,3260] successful.
Oct 25 18:22:59 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4c4d91f-3129-4221-95bf-e33cae717741 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba74ea4-69e0-4799-b1fc-9ab27f36a365]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] <== disconnect_volume: return (323ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:22:59 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:23:00 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'flavor' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:23:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1cffea32-d71d-4a30-86e5-41c62b5c5a40 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid b1be4b31-34e2-4e28-a9af-e928087a34c3 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid 7e376d96-8f5e-4064-a9ee-c02985c43ae2 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid bb15516e-f44b-456d-84e2-5de0c8f1e869 {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [{"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-3cdbde0e-91ef-412c-b08e-0b5f815feada" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:23:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:23:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:29 user nova-compute[74739]: INFO nova.compute.manager [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Terminating instance
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.compute.manager [req-c089af9a-7642-46c9-86b3-922f84eeb1c1 req-93ee096d-4d8a-4cf5-ad19-453f54eee995 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-unplugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Instance destroyed successfully.
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid 3cdbde0e-91ef-412c-b08e-0b5f815feada {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1077796870',display_name='tempest-ServerRescueNegativeTestJSON-server-1077796870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1077796870',id=42,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu1SY1jEOTgWbm0QLhi+LujfNRrApUREMa5VU3G5HTEJVekPjMn/58omn1jJ6shWcQSorave53rwXl44MEZ5mHbnkX6Oja8FDbU/ynK9VddBGLZQ3x8qwchdjHneFrP+Q==',key_name='tempest-keypair-1611187428',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:19:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-790gevkz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=3cdbde0e-91ef-412c-b08e-0b5f815feada,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "address": "fa:16:3e:3d:19:72", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3c07012-c3", "ovs_interfaceid": "f3c07012-c3a5-4828-b7e6-c16c56e2a120", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG os_vif [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3c07012-c3, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=822be9d0-b6fa-4f2e-a957-7e43309f4237) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:29 user nova-compute[74739]: INFO os_vif [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:19:72,bridge_name='br-int',has_traffic_filtering=True,id=f3c07012-c3a5-4828-b7e6-c16c56e2a120,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3c07012-c3')
Oct 25 18:23:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Deleting instance files /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada_del
Oct 25 18:23:29 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Deletion of /opt/stack/data/nova/instances/3cdbde0e-91ef-412c-b08e-0b5f815feada_del complete
Oct 25 18:23:29 user nova-compute[74739]: INFO nova.compute.manager [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 25 18:23:29 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:23:29 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:23:30 user nova-compute[74739]: INFO nova.compute.manager [None req-c9e655a6-14fc-4b8d-a6e3-67a8d530db26 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Get console output
Oct 25 18:23:30 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:23:30 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Took 0.73 seconds to deallocate network for instance.
Oct 25 18:23:30 user nova-compute[74739]: DEBUG nova.compute.manager [req-9eea8bb0-cc56-4e9a-b1c9-fb29a9db1daa req-d4487008-033d-49a3-9500-5aa09447567e service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-deleted-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:23:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:30 user nova-compute[74739]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 25 18:23:30 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:23:30 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:23:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:30 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Deleted allocations for instance 3cdbde0e-91ef-412c-b08e-0b5f815feada
Oct 25 18:23:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f849cd48-ac79-4fc2-9baf-906152b9fb02 tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:23:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] Acquiring lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] Lock "3cdbde0e-91ef-412c-b08e-0b5f815feada-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] No waiting events found dispatching network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:23:31 user nova-compute[74739]: WARNING nova.compute.manager [req-52a0c7cf-7777-4e4d-9560-702c77bad1d0 req-4ad2bf17-d98e-4d4b-8670-c05cdd3e02d9 service nova] [instance: 3cdbde0e-91ef-412c-b08e-0b5f815feada] Received unexpected event network-vif-plugged-f3c07012-c3a5-4828-b7e6-c16c56e2a120 for instance with vm_state deleted and task_state None.
Oct 25 18:23:32 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:23:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:23:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:23:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:23:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8380MB free_disk=24.928852081298828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:23:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b1be4b31-34e2-4e28-a9af-e928087a34c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance bb15516e-f44b-456d-84e2-5de0c8f1e869 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:23:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:23:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:23:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:23:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:23:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:23:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:23:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing instance network info cache due to event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] Acquiring lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] Acquired lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updated VIF entry in instance network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating instance_info_cache with network_info: [{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-019a39db-8e82-42a8-9518-093a2de1a2b2 req-2e63c3d8-43fa-4549-b2b9-0a6c15c4d715 service nova] Releasing lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing instance network info cache due to event network-changed-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] Acquiring lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] Acquired lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Refreshing network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:23 user nova-compute[74739]: INFO nova.compute.manager [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Terminating instance
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-unplugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] No waiting events found dispatching network-vif-unplugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.compute.manager [req-c687e7a6-13ea-4fe0-8482-068df65242a9 req-642833ff-e192-4569-971f-5e3a72543941 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-unplugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updated VIF entry in instance network info cache for port ffb278ac-6163-4a9a-96bb-5a3b32a62bfb. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating instance_info_cache with network_info: [{"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f6e36eee-6e26-4d09-a587-9212a9e67f42 req-21637c71-3b41-4721-8b48-bff296c3f2d8 service nova] Releasing lock "refresh_cache-bb15516e-f44b-456d-84e2-5de0c8f1e869" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:24:23 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Instance destroyed successfully.
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid bb15516e-f44b-456d-84e2-5de0c8f1e869 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:22:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1697552087',display_name='tempest-TestVolumeBootPattern-server-1697552087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1697552087',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-jbi9eadh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:22:53Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=bb15516e-f44b-456d-84e2-5de0c8f1e869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "address": "fa:16:3e:2b:80:e8", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffb278ac-61", "ovs_interfaceid": "ffb278ac-6163-4a9a-96bb-5a3b32a62bfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_vif [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffb278ac-61, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e71f102e-29bd-4449-a165-0d2b62f23a59) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:23 user nova-compute[74739]: INFO os_vif [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:80:e8,bridge_name='br-int',has_traffic_filtering=True,id=ffb278ac-6163-4a9a-96bb-5a3b32a62bfb,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffb278ac-61')
Oct 25 18:24:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmrjLBUg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:24:23 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4f3c8-a30a-4602-b1d1-903e8f5e9096]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:24:23 user nova-compute[74739]: No targets found.
Oct 25 18:24:23 user nova-compute[74739]: iSNS:
Oct 25 18:24:23 user nova-compute[74739]: No targets found.
Oct 25 18:24:23 user nova-compute[74739]: STATIC:
Oct 25 18:24:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f
Oct 25 18:24:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:24:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:24:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6
Oct 25 18:24:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:24:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:24:23 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e
Oct 25 18:24:23 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:24:23 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:24:23 user nova-compute[74739]: FIRMWARE:
Oct 25 18:24:23 user nova-compute[74739]: No targets found.
Oct 25 18:24:23 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:24:23 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:24:23 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c280886c-8a00-4efa-af2a-a734ae1cc514]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:23 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa87ef3-5d7e-4b77-8e77-a72a79a7c5ff]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:24:24 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:24:24 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:24:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:24:24 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:24:24 user nova-compute[74739]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f (non-flash)
Oct 25 18:24:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2ec437c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f'): ({'sde'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sde {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a671c6f-a99a-4e07-b560-2c54effd3803]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb492df1-2db9-42c1-9aea-958290bdd4b1]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sde {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f048654-3599-4793-bf00-0f5bfbb2ab03]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb72e05e-8dc3-432a-b5c3-6c418acd5599]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sde have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba590f61', '/dev/disk/by-id/scsi-1SCST_BIOba590f61-99886337223ad4b7', '/dev/disk/by-id/scsi-23939383836333337') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aa8c0e-a1ab-48cf-8ad3-4e66b7f568b2]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7ed60b-5db9-49b0-b80d-9fe070aa7219]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a70e5f9-744b-45bc-b0dd-558c786d7382]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260]
Oct 25 18:24:24 user nova-compute[74739]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f, portal: 172.16.0.220,3260] successful.
Oct 25 18:24:24 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e98ef2-7764-4797-a819-d67d321fe52f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91a4e1-e9e6-49ce-af93-84d5ed93c01a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (351ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:24:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Deleting instance files /opt/stack/data/nova/instances/bb15516e-f44b-456d-84e2-5de0c8f1e869_del
Oct 25 18:24:24 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Deletion of /opt/stack/data/nova/instances/bb15516e-f44b-456d-84e2-5de0c8f1e869_del complete
Oct 25 18:24:24 user nova-compute[74739]: INFO nova.compute.manager [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 18:24:24 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:24:24 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:24 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Took 0.41 seconds to deallocate network for instance.
Oct 25 18:24:25 user nova-compute[74739]: INFO nova.compute.manager [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Took 0.82 seconds to detach 1 volumes for instance.
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] Acquiring lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] No waiting events found dispatching network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:25 user nova-compute[74739]: WARNING nova.compute.manager [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received unexpected event network-vif-plugged-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb for instance with vm_state active and task_state deleting.
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-ee044f84-6c33-4093-93a4-498f8db68cc1 req-c63ba3dc-f896-4be6-96bb-464cab6449ce service nova] [instance: bb15516e-f44b-456d-84e2-5de0c8f1e869] Received event network-vif-deleted-ffb278ac-6163-4a9a-96bb-5a3b32a62bfb {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:25 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance bb15516e-f44b-456d-84e2-5de0c8f1e869
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:24:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-66e6fcf2-9235-45b7-8f39-d66a52dcb9fd tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "bb15516e-f44b-456d-84e2-5de0c8f1e869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.830s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:26 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [{"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-b1be4b31-34e2-4e28-a9af-e928087a34c3" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:24:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:24:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:31 user nova-compute[74739]: INFO nova.compute.manager [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Terminating instance
Oct 25 18:24:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-01a6d27e-2565-4aec-b084-9a90095429b2 req-ef373309-96c3-45ff-ab0b-02e31a139546 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-unplugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Instance destroyed successfully.
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'resources' on Instance uuid b1be4b31-34e2-4e28-a9af-e928087a34c3 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:17:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-761348612',display_name='tempest-ServerActionsTestOtherA-server-761348612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-761348612',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:20:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-680na7ks',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=b1be4b31-34e2-4e28-a9af-e928087a34c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "518cf5bf-9316-4661-ab79-d40cd6405a99", "address": "fa:16:3e:64:df:81", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap518cf5bf-93", "ovs_interfaceid": "518cf5bf-9316-4661-ab79-d40cd6405a99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_vif [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap518cf5bf-93, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93461144-8cc9-4f9e-8d75-34a0991d03b7) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:32 user nova-compute[74739]: INFO os_vif [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:df:81,bridge_name='br-int',has_traffic_filtering=True,id=518cf5bf-9316-4661-ab79-d40cd6405a99,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap518cf5bf-93')
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjdmyFZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:24:32 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d51762-1774-414b-baab-c321f15c8c57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:24:32 user nova-compute[74739]: No targets found.
Oct 25 18:24:32 user nova-compute[74739]: iSNS:
Oct 25 18:24:32 user nova-compute[74739]: No targets found.
Oct 25 18:24:32 user nova-compute[74739]: STATIC:
Oct 25 18:24:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6
Oct 25 18:24:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:24:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:24:32 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e
Oct 25 18:24:32 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:24:32 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:24:32 user nova-compute[74739]: FIRMWARE:
Oct 25 18:24:32 user nova-compute[74739]: No targets found.
Oct 25 18:24:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:24:32 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:24:32 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe1c164-88ba-4893-861e-f80608ceff1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b51a7-82fb-4d20-ae6c-0296c5c2e6c9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:24:32 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:24:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 (non-flash)
Oct 25 18:24:32 user nova-compute[74739]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:24:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc1912d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[06365549-9044-4b58-b55b-09b5d26cbade]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f662d4e0-fe83-4f31-bb72-1ea54f69a9c8]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a16f6b-2a00-4a21-ae1e-4ad29262983a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e891f8-88f7-4960-ae21-6fc42ac2491f]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23331303162623531', '/dev/disk/by-id/scsi-1SCST_BIOb17b0ee3-3101bb51c391ed15', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b17b0ee3') {{(pid=86127) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8eb457-12bc-4603-b957-d17892d6258a]: (4, None) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6753d6e8-b98b-41ff-884f-112083b04c53]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63f2e47-44b2-4a50-9e2b-88a0ad44db27]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260]
Oct 25 18:24:32 user nova-compute[74739]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6, portal: 172.16.0.220,3260] successful.
Oct 25 18:24:32 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01b3d884-5cd5-4f05-a7e9-8c34958363c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7ae6c-0224-4fd2-95c3-9c783c5b4dc5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] <== disconnect_volume: return (311ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:24:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Deleting instance files /opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3_del
Oct 25 18:24:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Deletion of /opt/stack/data/nova/instances/b1be4b31-34e2-4e28-a9af-e928087a34c3_del complete
Oct 25 18:24:32 user nova-compute[74739]: INFO nova.compute.manager [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 25 18:24:32 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:24:32 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:33 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Took 0.64 seconds to deallocate network for instance.
Oct 25 18:24:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-04d9c69d-8248-4efc-ad70-6410f998f50a req-3cff8f9b-9e2e-45dd-b4f5-9d24c3e79260 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-deleted-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] Acquiring lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] No waiting events found dispatching network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:33 user nova-compute[74739]: WARNING nova.compute.manager [req-f836e4a9-8234-4a4d-9ab8-b7288d1793de req-4b214e75-86d2-4f59-9385-42589cb71b31 service nova] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Received unexpected event network-vif-plugged-518cf5bf-9316-4661-ab79-d40cd6405a99 for instance with vm_state active and task_state deleting.
Oct 25 18:24:34 user nova-compute[74739]: INFO nova.compute.manager [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Took 0.89 seconds to detach 1 volumes for instance.
Oct 25 18:24:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: b1be4b31-34e2-4e28-a9af-e928087a34c3] Deleting volume: 01b3d884-5cd5-4f05-a7e9-8c34958363c6 {{(pid=74739) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:34 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Deleted allocations for instance b1be4b31-34e2-4e28-a9af-e928087a34c3
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-1f98109a-b711-4c10-b867-91f91fd5ffd4 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "b1be4b31-34e2-4e28-a9af-e928087a34c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:35 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:36 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:24:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:24:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:24:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=24.919727325439453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:24:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:41 user nova-compute[74739]: INFO nova.compute.manager [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Terminating instance
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-bacf3961-deab-43a4-a826-0aecc6fec592 req-48959d04-d850-49db-9a65-fb0206f4a534 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-unplugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Instance destroyed successfully.
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.objects.instance [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1908841081',display_name='tempest-ServerRescueNegativeTestJSON-server-1908841081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1908841081',id=36,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-0c6gh0pf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:10:03Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "address": "fa:16:3e:1e:74:68", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf39225-a4", "ovs_interfaceid": "eaf39225-a413-43c6-b9d1-04e9bf193d39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG os_vif [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaf39225-a4, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b55f6130-c986-4db0-bde1-06f08786b20b) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:41 user nova-compute[74739]: INFO os_vif [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:74:68,bridge_name='br-int',has_traffic_filtering=True,id=eaf39225-a413-43c6-b9d1-04e9bf193d39,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf39225-a4')
Oct 25 18:24:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Deleting instance files /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0_del
Oct 25 18:24:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Deletion of /opt/stack/data/nova/instances/b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0_del complete
Oct 25 18:24:42 user nova-compute[74739]: INFO nova.compute.manager [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 25 18:24:42 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:24:42 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Took 0.40 seconds to deallocate network for instance.
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.compute.manager [req-14bd8dd8-e5c2-48e4-8a7e-454639854a7e req-80b0520d-c977-4471-9637-ef16b4d16733 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-deleted-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:24:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:42 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Deleted allocations for instance b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0
Oct 25 18:24:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-61556c00-6fc6-4f8a-b6c4-c3b1366a75aa tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:24:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] Acquiring lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:24:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:24:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] Lock "b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:24:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] No waiting events found dispatching network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:24:43 user nova-compute[74739]: WARNING nova.compute.manager [req-1c4f359d-e5cc-4761-a8b0-fe425ccdd208 req-ccb7ddcf-d864-4a38-bbcb-6659607b3cf1 service nova] [instance: b9f715b2-b54c-40eb-ab1f-bdaf623ecdc0] Received unexpected event network-vif-plugged-eaf39225-a413-43c6-b9d1-04e9bf193d39 for instance with vm_state deleted and task_state None.
Oct 25 18:24:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:24:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:24:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:24:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:24:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:23 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:25:25 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:25:26 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [{"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c5e5321b-04b9-40b9-8038-9f85cf4daf7e" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:25:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:25:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:31 user nova-compute[74739]: INFO nova.compute.manager [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Terminating instance
Oct 25 18:25:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG nova.compute.manager [req-e12e996b-731c-4294-a1b2-fb43a223607d req-60c2bd3c-fdba-41af-9b60-e40eba57c054 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-unplugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:25:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Instance destroyed successfully.
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lazy-loading 'resources' on Instance uuid 5eea09f6-2a67-47d3-ba47-356a73a68b67 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:08:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1416959544',display_name='tempest-ServerRescueNegativeTestJSON-server-1416959544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1416959544',id=35,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6417911f3bca47d08fbc396de0d54266',ramdisk_id='',reservation_id='r-qk44zhze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-249751618',owner_user_name='tempest-ServerRescueNegativeTestJSON-249751618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:14:50Z,user_data=None,user_id='2fc3ef31d7e6446ea7f8667172ce012d',uuid=5eea09f6-2a67-47d3-ba47-356a73a68b67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converting VIF {"id": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "address": "fa:16:3e:77:40:01", "network": {"id": "cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1052187419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6417911f3bca47d08fbc396de0d54266", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5936a-a8", "ovs_interfaceid": "7ff5936a-a844-4cc9-abb9-f0e591e57e23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG os_vif [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff5936a-a8, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1c814a5-26aa-417c-9b75-bcb3a8eb2fce) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:32 user nova-compute[74739]: INFO os_vif [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:40:01,bridge_name='br-int',has_traffic_filtering=True,id=7ff5936a-a844-4cc9-abb9-f0e591e57e23,network=Network(cd2d01c0-3f3c-42d2-9bb6-640a6eba8e06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ff5936a-a8')
Oct 25 18:25:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Deleting instance files /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67_del
Oct 25 18:25:32 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Deletion of /opt/stack/data/nova/instances/5eea09f6-2a67-47d3-ba47-356a73a68b67_del complete
Oct 25 18:25:32 user nova-compute[74739]: INFO nova.compute.manager [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:32 user nova-compute[74739]: INFO nova.compute.manager [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Terminating instance
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-unplugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] No waiting events found dispatching network-vif-unplugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-e809b101-685a-4daf-9505-4d4db6480ae4 req-17105fcb-5b9a-4667-a074-2852e03f61b1 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-unplugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Took 0.77 seconds to deallocate network for instance.
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0391764-e395-4865-bfeb-6a14df78f649 req-46d0559b-6013-4564-b1e7-914dc944fa73 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-deleted-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.compute.manager [req-c0391764-e395-4865-bfeb-6a14df78f649 req-46d0559b-6013-4564-b1e7-914dc944fa73 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Neutron deleted interface 7ff5936a-a844-4cc9-abb9-f0e591e57e23; detaching it from the instance and deleting it from the info cache
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-c0391764-e395-4865-bfeb-6a14df78f649 req-46d0559b-6013-4564-b1e7-914dc944fa73 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0391764-e395-4865-bfeb-6a14df78f649 req-46d0559b-6013-4564-b1e7-914dc944fa73 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Detach interface failed, port_id=7ff5936a-a844-4cc9-abb9-f0e591e57e23, reason: Instance 5eea09f6-2a67-47d3-ba47-356a73a68b67 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Instance destroyed successfully.
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lazy-loading 'resources' on Instance uuid c5e5321b-04b9-40b9-8038-9f85cf4daf7e {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-113405100',display_name='tempest-ServerActionsTestOtherA-server-113405100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-113405100',id=31,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSYu5fU+MvzKhy4hXBUns6lc6ybyAAFyXO5G0MrBCaQvDP+DZ3imht1RFrp9hI5ghnfLzbijcMfly1ORScRCykgrcv6kjpGrNTYYIARah3l0Fv4L4+7IwCGsHJeJeezig==',key_name='tempest-keypair-365344759',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee2286f0b19a436897ed0d9c42991e06',ramdisk_id='',reservation_id='r-0fpooj7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1860404749',owner_user_name='tempest-ServerActionsTestOtherA-1860404749-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0a42eef8b354d4fad0b4eb277270cb4',uuid=c5e5321b-04b9-40b9-8038-9f85cf4daf7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converting VIF {"id": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "address": "fa:16:3e:c3:ad:47", "network": {"id": "38cfdae5-a84e-4935-a39e-50bdf6784ebe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-50273171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee2286f0b19a436897ed0d9c42991e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd5bf9d3-ef", "ovs_interfaceid": "bd5bf9d3-ef73-43ea-8402-52ff583d78c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG os_vif [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd5bf9d3-ef, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b77466c1-6ee5-4971-b746-5ed8609423fe) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:33 user nova-compute[74739]: INFO os_vif [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ad:47,bridge_name='br-int',has_traffic_filtering=True,id=bd5bf9d3-ef73-43ea-8402-52ff583d78c3,network=Network(38cfdae5-a84e-4935-a39e-50bdf6784ebe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd5bf9d3-ef')
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Deleting instance files /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e_del
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Deletion of /opt/stack/data/nova/instances/c5e5321b-04b9-40b9-8038-9f85cf4daf7e_del complete
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Deleted allocations for instance 5eea09f6-2a67-47d3-ba47-356a73a68b67
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.compute.manager [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Terminating instance
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:25:33 user nova-compute[74739]: INFO nova.compute.manager [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-38728259-12a8-4cf4-a250-68896d1d507e tempest-ServerRescueNegativeTestJSON-249751618 tempest-ServerRescueNegativeTestJSON-249751618-project-member] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] Acquiring lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] Lock "5eea09f6-2a67-47d3-ba47-356a73a68b67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] No waiting events found dispatching network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:34 user nova-compute[74739]: WARNING nova.compute.manager [req-c0bf6a00-3c80-4973-87ac-d8f9d54e8cdb req-a390b3ce-62f2-4830-a147-c431199ffe16 service nova] [instance: 5eea09f6-2a67-47d3-ba47-356a73a68b67] Received unexpected event network-vif-plugged-7ff5936a-a844-4cc9-abb9-f0e591e57e23 for instance with vm_state deleted and task_state None.
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance destroyed successfully.
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.objects.instance [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lazy-loading 'resources' on Instance uuid 7e376d96-8f5e-4064-a9ee-c02985c43ae2 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:20:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1693841581',display_name='tempest-TestVolumeBootPattern-server-1693841581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1693841581',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fKHGYFbA8ABtp57UigQLKCq5ujLatTo9Hski/Pi4NHOhmr8sI1U6QD+Maof12IxDRVn0ou4Cd3xJRmnFc5WSk6+8H88g2k4b/PcwevWX8VPvSD/WPIeCo4MvQPaOrfA==',key_name='tempest-TestVolumeBootPattern-1997611090',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:20:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bfa536399c34f8d8321bf6f69ef0cd6',ramdisk_id='',reservation_id='r-tf5xcf94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2117961967',owner_user_name='tempest-TestVolumeBootPattern-2117961967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:20:45Z,user_data=None,user_id='4ad7394ee72341c7b091dc93d9c919e2',uuid=7e376d96-8f5e-4064-a9ee-c02985c43ae2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converting VIF {"id": "e529988a-400c-49cf-87fb-c551ca24318b", "address": "fa:16:3e:0b:37:08", "network": {"id": "57314c5d-5a14-4432-aea0-c554b8097faf", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1068903374-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bfa536399c34f8d8321bf6f69ef0cd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape529988a-40", "ovs_interfaceid": "e529988a-400c-49cf-87fb-c551ca24318b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_vif [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape529988a-40, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b240542-a3ff-48ec-9a9b-b516257c6354) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Took 0.81 seconds to deallocate network for instance.
Oct 25 18:25:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:34 user nova-compute[74739]: INFO os_vif [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:37:08,bridge_name='br-int',has_traffic_filtering=True,id=e529988a-400c-49cf-87fb-c551ca24318b,network=Network(57314c5d-5a14-4432-aea0-c554b8097faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape529988a-40')
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPqjJTBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:25:34 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc16f94e-82e7-433c-bea5-53ff3c46c602]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:25:34 user nova-compute[74739]: No targets found.
Oct 25 18:25:34 user nova-compute[74739]: iSNS:
Oct 25 18:25:34 user nova-compute[74739]: No targets found.
Oct 25 18:25:34 user nova-compute[74739]: STATIC:
Oct 25 18:25:34 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e
Oct 25 18:25:34 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:25:34 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:25:34 user nova-compute[74739]: FIRMWARE:
Oct 25 18:25:34 user nova-compute[74739]: No targets found.
Oct 25 18:25:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:25:34 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:25:34 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[148d6e83-2f68-4537-b553-376b56083143]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f79bd9-4b40-4ca8-b809-6645fe10d5e5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:25:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e (non-flash)
Oct 25 18:25:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc191bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e'): ({'sdc'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Removing single pathed devices sdc {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412c722-5c43-4479-89c6-eb4caf2e1f25]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8df97c-cd75-44b1-baa8-4e3d33169076]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Flushing IO for device /dev/sdc {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a3accb-b276-4ed5-ac78-c0a908100c22]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9b937f-e644-4049-95c2-ad8b7a4513eb]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] SCSI volumes sdc have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f2fb1-af1a-4154-896c-a0003be4e5f0]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Deleted allocations for instance c5e5321b-04b9-40b9-8038-9f85cf4daf7e
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85174d9-25c4-4fd1-bfaa-4481509acce9]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260]
Oct 25 18:25:34 user nova-compute[74739]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e, portal: 172.16.0.220,3260] successful.
Oct 25 18:25:34 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5df8714f-b7b9-405b-8333-201b45635d5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c72c1-f413-4797-899d-07b3d7975bcd]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] <== disconnect_volume: return (308ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Deleting instance files /opt/stack/data/nova/instances/7e376d96-8f5e-4064-a9ee-c02985c43ae2_del
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Deletion of /opt/stack/data/nova/instances/7e376d96-8f5e-4064-a9ee-c02985c43ae2_del complete
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f3f29e56-62ea-436e-9cd9-c8cde4022026 tempest-ServerActionsTestOtherA-1860404749 tempest-ServerActionsTestOtherA-1860404749-project-member] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:34 user nova-compute[74739]: INFO nova.compute.manager [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:25:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Acquiring lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "c5e5321b-04b9-40b9-8038-9f85cf4daf7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] No waiting events found dispatching network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:35 user nova-compute[74739]: WARNING nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received unexpected event network-vif-plugged-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 for instance with vm_state deleted and task_state None.
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-unplugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] No waiting events found dispatching network-vif-unplugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-unplugged-e529988a-400c-49cf-87fb-c551ca24318b for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Acquiring lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] No waiting events found dispatching network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:25:35 user nova-compute[74739]: WARNING nova.compute.manager [req-5c66844b-a903-40d8-8ff5-4e8307206984 req-17074d08-7412-4e3a-9823-14c7420ce3e2 service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received unexpected event network-vif-plugged-e529988a-400c-49cf-87fb-c551ca24318b for instance with vm_state active and task_state deleting.
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:35 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Took 0.40 seconds to deallocate network for instance.
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-changed-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing instance network info cache due to event network-changed-e529988a-400c-49cf-87fb-c551ca24318b. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] Acquiring lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] Acquired lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Refreshing network info cache for port e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.network.neutron [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] Releasing lock "refresh_cache-7e376d96-8f5e-4064-a9ee-c02985c43ae2" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: c5e5321b-04b9-40b9-8038-9f85cf4daf7e] Received event network-vif-deleted-bd5bf9d3-ef73-43ea-8402-52ff583d78c3 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-eaa18e95-150a-4fa1-986b-a04075a452e8 req-e385790c-10b2-4ad1-a26b-697dcf2e0cae service nova] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Received event network-vif-deleted-e529988a-400c-49cf-87fb-c551ca24318b {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:25:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:36 user nova-compute[74739]: INFO nova.compute.manager [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] [instance: 7e376d96-8f5e-4064-a9ee-c02985c43ae2] Took 0.81 seconds to detach 1 volumes for instance.
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:36 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Deleted allocations for instance 7e376d96-8f5e-4064-a9ee-c02985c43ae2
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-c1560a2d-fc68-49d4-b789-0760c1d50bab tempest-TestVolumeBootPattern-2117961967 tempest-TestVolumeBootPattern-2117961967-project-member] Lock "7e376d96-8f5e-4064-a9ee-c02985c43ae2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.701s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:25:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:25:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9046MB free_disk=25.002593994140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:25:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:25:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:25:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:25:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:25:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:25:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:26:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:24 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:26:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:26:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:26:34 user nova-compute[74739]: INFO nova.compute.claims [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Claim successful on node user
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:26:34 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:26:34 user nova-compute[74739]: DEBUG nova.policy [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7655943dc394a63b416a6817e27a5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da7cca5578f464eb82b3b8ddf64b92f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:26:35 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Creating image(s)
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.216s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk 1073741824" returned: 0 in 0.070s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Cannot resize image /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Ensure instance console log exists: /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Successfully created port: 97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:36 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Successfully updated port: 97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.manager [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-changed-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.manager [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Refreshing instance network info cache due to event network-changed-97befbd9-dfd6-4046-bd50-f4fea1c1e571. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Refreshing network info cache for port 97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:26:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:26:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.00011444091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-a4136d50-e45a-4039-b991-720dccabfa32 req-a3e8cff8-07e1-41ef-8fdf-9c32e6b62dde service nova] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.neutron [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance network_info: |[{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Start _get_guest_xml network_info=[{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:26:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:26:37 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-319818817',display_name='tempest-AttachVolumeNegativeTest-server-319818817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-319818817',id=47,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2gHm5vls2sZBEIgJlnnlnuyNQcGdUaw4WQBnWDME/tT2AjRNiULbBsczF0zUaui212sXEGKoRDwCAE9bMJdEL8brM0XOEpgY2Bkxz43mRMx6C5KMyXAzMo11q5MvjMgg==',key_name='tempest-keypair-768063147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-29ux8ga1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=d2f9cc63-ec2e-4b14-8719-3b70c01e62ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.objects.instance [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'pci_devices' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:26:37 user nova-compute[74739]:   <uuid>d2f9cc63-ec2e-4b14-8719-3b70c01e62ab</uuid>
Oct 25 18:26:37 user nova-compute[74739]:   <name>instance-0000002f</name>
Oct 25 18:26:37 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:26:37 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:26:37 user nova-compute[74739]:   <metadata>
Oct 25 18:26:37 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:26:37 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeNegativeTest-server-319818817</nova:name>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:26:37</nova:creationTime>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:26:37 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:26:37 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:owner>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:user uuid="b7655943dc394a63b416a6817e27a5de">tempest-AttachVolumeNegativeTest-698356987-project-member</nova:user>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:project uuid="3da7cca5578f464eb82b3b8ddf64b92f">tempest-AttachVolumeNegativeTest-698356987</nova:project>
Oct 25 18:26:37 user nova-compute[74739]:       </nova:owner>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:26:37 user nova-compute[74739]:       <nova:ports>
Oct 25 18:26:37 user nova-compute[74739]:         <nova:port uuid="97befbd9-dfd6-4046-bd50-f4fea1c1e571">
Oct 25 18:26:37 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 25 18:26:37 user nova-compute[74739]:         </nova:port>
Oct 25 18:26:37 user nova-compute[74739]:       </nova:ports>
Oct 25 18:26:37 user nova-compute[74739]:     </nova:instance>
Oct 25 18:26:37 user nova-compute[74739]:   </metadata>
Oct 25 18:26:37 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:26:37 user nova-compute[74739]:     <system>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="serial">d2f9cc63-ec2e-4b14-8719-3b70c01e62ab</entry>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="uuid">d2f9cc63-ec2e-4b14-8719-3b70c01e62ab</entry>
Oct 25 18:26:37 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:26:37 user nova-compute[74739]:     </system>
Oct 25 18:26:37 user nova-compute[74739]:   </sysinfo>
Oct 25 18:26:37 user nova-compute[74739]:   <os>
Oct 25 18:26:37 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:26:37 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:26:37 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:26:37 user nova-compute[74739]:   </os>
Oct 25 18:26:37 user nova-compute[74739]:   <features>
Oct 25 18:26:37 user nova-compute[74739]:     <acpi/>
Oct 25 18:26:37 user nova-compute[74739]:     <apic/>
Oct 25 18:26:37 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:26:37 user nova-compute[74739]:   </features>
Oct 25 18:26:37 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:26:37 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:26:37 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:26:37 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:26:37 user nova-compute[74739]:   </clock>
Oct 25 18:26:37 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:26:37 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:26:37 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:26:37 user nova-compute[74739]:   </cpu>
Oct 25 18:26:37 user nova-compute[74739]:   <devices>
Oct 25 18:26:37 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:26:37 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:26:37 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk"/>
Oct 25 18:26:37 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:26:37 user nova-compute[74739]:     </disk>
Oct 25 18:26:37 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:26:37 user nova-compute[74739]:       <mac address="fa:16:3e:6c:9c:66"/>
Oct 25 18:26:37 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:26:37 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:26:37 user nova-compute[74739]:       <target dev="tap97befbd9-df"/>
Oct 25 18:26:37 user nova-compute[74739]:     </interface>
Oct 25 18:26:37 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:26:37 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/console.log" append="off"/>
Oct 25 18:26:37 user nova-compute[74739]:     </serial>
Oct 25 18:26:37 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:26:37 user nova-compute[74739]:     <video>
Oct 25 18:26:37 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:26:37 user nova-compute[74739]:     </video>
Oct 25 18:26:37 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:26:37 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:26:37 user nova-compute[74739]:     </rng>
Oct 25 18:26:37 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:26:37 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:26:37 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:26:37 user nova-compute[74739]:     </memballoon>
Oct 25 18:26:37 user nova-compute[74739]:   </devices>
Oct 25 18:26:37 user nova-compute[74739]: </domain>
Oct 25 18:26:37 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-319818817',display_name='tempest-AttachVolumeNegativeTest-server-319818817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-319818817',id=47,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2gHm5vls2sZBEIgJlnnlnuyNQcGdUaw4WQBnWDME/tT2AjRNiULbBsczF0zUaui212sXEGKoRDwCAE9bMJdEL8brM0XOEpgY2Bkxz43mRMx6C5KMyXAzMo11q5MvjMgg==',key_name='tempest-keypair-768063147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-29ux8ga1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:26:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=d2f9cc63-ec2e-4b14-8719-3b70c01e62ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG os_vif [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:26:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c79c0180-6a84-5473-bf11-f7a08edbee24', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97befbd9-df, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97befbd9-df, col_values=(('qos', UUID('1897bcf7-3f8f-415a-b32e-1ef647250752')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97befbd9-df, col_values=(('external_ids', {'iface-id': '97befbd9-dfd6-4046-bd50-f4fea1c1e571', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:9c:66', 'vm-uuid': 'd2f9cc63-ec2e-4b14-8719-3b70c01e62ab'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:38 user nova-compute[74739]: INFO os_vif [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df')
Oct 25 18:26:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:6c:9c:66, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG nova.compute.manager [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:39 user nova-compute[74739]: DEBUG nova.compute.manager [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] No waiting events found dispatching network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:26:39 user nova-compute[74739]: WARNING nova.compute.manager [req-392c736f-e09e-4af1-aff5-380bdb825d27 req-a54532e9-4310-494b-b058-49812000e0da service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received unexpected event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 for instance with vm_state building and task_state spawning.
Oct 25 18:26:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:26:41 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance spawned successfully.
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.compute.manager [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] No waiting events found dispatching network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:26:41 user nova-compute[74739]: WARNING nova.compute.manager [req-58000856-8300-41df-82d9-2c840a730bbe req-28ec3126-cd1b-42ff-b76e-25bc8e8b40d4 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received unexpected event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 for instance with vm_state building and task_state spawning.
Oct 25 18:26:41 user nova-compute[74739]: INFO nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Took 6.91 seconds to spawn the instance on the hypervisor.
Oct 25 18:26:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:26:42 user nova-compute[74739]: INFO nova.compute.manager [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Took 7.47 seconds to build instance.
Oct 25 18:26:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-dfe6ce71-3d02-4e31-b31a-5a4159b9383c tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.581s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:26:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:26:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:26:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:26:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:27:28 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:27:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:27:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:27:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:27:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:27:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:27:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:27:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.96206283569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:27:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:27:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:27:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:27:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:27:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:27:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-changed-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG nova.compute.manager [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Refreshing instance network info cache due to event network-changed-97befbd9-dfd6-4046-bd50-f4fea1c1e571. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG nova.network.neutron [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Refreshing network info cache for port 97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:28:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:26 user nova-compute[74739]: DEBUG nova.network.neutron [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updated VIF entry in instance network info cache for port 97befbd9-dfd6-4046-bd50-f4fea1c1e571. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:28:26 user nova-compute[74739]: DEBUG nova.network.neutron [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:28:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9ea3e3f0-935b-4bd5-ade7-365a4cf510b8 req-292c80df-c442-4c69-b077-c893e87b9187 service nova] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:28:26 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:28:29 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG nova.objects.instance [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:30 user nova-compute[74739]: INFO nova.compute.manager [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Attaching volume 5f87085e-c249-4396-a23e-afb450b84805 to /dev/vdb
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f72443-e9fd-4b1e-bfd8-67ccbc2467b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e29163-aaea-4530-b4f6-999631e7c1f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b25119-c085-40bf-95c3-c05f37e0b5db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ad74f-3cad-4c6d-8f4e-26dd3482b752]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:28:30 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:28:30 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e11690f-bedc-45ce-8bd0-4efc2bcb78b7]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG os_brick.utils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating existing volume attachment record: 66be6c27-6f64-43ac-b235-398fb5fb6c19 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:28:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:28:38 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:28:39 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:28:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.959877014160156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:28:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:28:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsQeciSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:28:46 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:28:46 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:28:46 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc12119-f4bc-4efe-ba83-e075fa7a9c3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:28:46 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6452587-011e-41cb-8318-ad1b2efa6943]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805] added
Oct 25 18:28:46 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3843b16-1447-407f-b9bb-687f328b29b6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd51f2ce-e3e2-4c2e-8b57-73d93d904101]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:46 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsQeciSL {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qsQeciSL" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[257d3def-e34a-4f6d-9f10-584813f03e93]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qsQeciSL'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d52ad1-13f6-4776-9295-2c82f73b2815]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59752b9c-c4ac-4094-819d-5e357538fbd9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:28:47 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:28:47 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:28:47 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:28:47 user nova-compute[74739]: 
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d14eb3-7aa9-46ca-9d38-633c11c1a4a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260]
Oct 25 18:28:47 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260] successful.
Oct 25 18:28:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8569d-2175-41b9-af41-76586e4a036a]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[16689766-2537-422d-ae83-47a87e477f38]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)
Oct 25 18:28:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)
Oct 25 18:28:47 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c9191-c164-4462-8125-ccdcf93735e8]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:28:47 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsQeciSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26334333339356362', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334333339356362', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:28:48 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:28:48 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:28:48 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:28:48 user nova-compute[74739]:   <serial>5f87085e-c249-4396-a23e-afb450b84805</serial>
Oct 25 18:28:48 user nova-compute[74739]: </disk>
Oct 25 18:28:48 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:6c:9c:66, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:28:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-97f01461-2040-49d0-ae34-1a295c94eaea tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.364s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:28:52 user nova-compute[74739]: INFO nova.compute.claims [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Claim successful on node user
Oct 25 18:28:52 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:28:52 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:53 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.policy [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7655943dc394a63b416a6817e27a5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da7cca5578f464eb82b3b8ddf64b92f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:28:53 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Creating image(s)
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "/opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk 1073741824" returned: 0 in 0.053s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Successfully created port: 3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.207s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:28:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Cannot resize image /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Ensure instance console log exists: /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Successfully updated port: 3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquired lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-changed-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.compute.manager [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Refreshing instance network info cache due to event network-changed-3d1588f2-cc4c-4ac3-b829-0ef5babd382f. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] Acquiring lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:28:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.neutron [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Releasing lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Instance network_info: |[{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] Acquired lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.neutron [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Refreshing network info cache for port 3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Start _get_guest_xml network_info=[{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:28:55 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:28:55 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-544011779',display_name='tempest-AttachVolumeNegativeTest-server-544011779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-544011779',id=48,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHtMJn4mpj1AUHrAGfDk1mBc3mI1oKNDZ3y7RjHX4+WT+ISDOf2WRVYVKKxjTHxvf9fCXYtyQN7kz7T7tonXzg6FMAKZlD5D0aVMVCbYU4RwEW7c2mSsfQruBwHwhlRUQ==',key_name='tempest-keypair-522084488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-ll4l6ctx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=57e36e88-8925-4ac1-975e-87847ec6b566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.objects.instance [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'pci_devices' on Instance uuid 57e36e88-8925-4ac1-975e-87847ec6b566 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:28:55 user nova-compute[74739]:   <uuid>57e36e88-8925-4ac1-975e-87847ec6b566</uuid>
Oct 25 18:28:55 user nova-compute[74739]:   <name>instance-00000030</name>
Oct 25 18:28:55 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:28:55 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:28:55 user nova-compute[74739]:   <metadata>
Oct 25 18:28:55 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:28:55 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeNegativeTest-server-544011779</nova:name>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:28:55</nova:creationTime>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:28:55 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:28:55 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:owner>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:user uuid="b7655943dc394a63b416a6817e27a5de">tempest-AttachVolumeNegativeTest-698356987-project-member</nova:user>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:project uuid="3da7cca5578f464eb82b3b8ddf64b92f">tempest-AttachVolumeNegativeTest-698356987</nova:project>
Oct 25 18:28:55 user nova-compute[74739]:       </nova:owner>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:28:55 user nova-compute[74739]:       <nova:ports>
Oct 25 18:28:55 user nova-compute[74739]:         <nova:port uuid="3d1588f2-cc4c-4ac3-b829-0ef5babd382f">
Oct 25 18:28:55 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:28:55 user nova-compute[74739]:         </nova:port>
Oct 25 18:28:55 user nova-compute[74739]:       </nova:ports>
Oct 25 18:28:55 user nova-compute[74739]:     </nova:instance>
Oct 25 18:28:55 user nova-compute[74739]:   </metadata>
Oct 25 18:28:55 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:28:55 user nova-compute[74739]:     <system>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="serial">57e36e88-8925-4ac1-975e-87847ec6b566</entry>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="uuid">57e36e88-8925-4ac1-975e-87847ec6b566</entry>
Oct 25 18:28:55 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:28:55 user nova-compute[74739]:     </system>
Oct 25 18:28:55 user nova-compute[74739]:   </sysinfo>
Oct 25 18:28:55 user nova-compute[74739]:   <os>
Oct 25 18:28:55 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:28:55 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:28:55 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:28:55 user nova-compute[74739]:   </os>
Oct 25 18:28:55 user nova-compute[74739]:   <features>
Oct 25 18:28:55 user nova-compute[74739]:     <acpi/>
Oct 25 18:28:55 user nova-compute[74739]:     <apic/>
Oct 25 18:28:55 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:28:55 user nova-compute[74739]:   </features>
Oct 25 18:28:55 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:28:55 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:28:55 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:28:55 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:28:55 user nova-compute[74739]:   </clock>
Oct 25 18:28:55 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:28:55 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:28:55 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:28:55 user nova-compute[74739]:   </cpu>
Oct 25 18:28:55 user nova-compute[74739]:   <devices>
Oct 25 18:28:55 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:28:55 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:28:55 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk"/>
Oct 25 18:28:55 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:28:55 user nova-compute[74739]:     </disk>
Oct 25 18:28:55 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:28:55 user nova-compute[74739]:       <mac address="fa:16:3e:47:78:aa"/>
Oct 25 18:28:55 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:28:55 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:28:55 user nova-compute[74739]:       <target dev="tap3d1588f2-cc"/>
Oct 25 18:28:55 user nova-compute[74739]:     </interface>
Oct 25 18:28:55 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:28:55 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/console.log" append="off"/>
Oct 25 18:28:55 user nova-compute[74739]:     </serial>
Oct 25 18:28:55 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:28:55 user nova-compute[74739]:     <video>
Oct 25 18:28:55 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:28:55 user nova-compute[74739]:     </video>
Oct 25 18:28:55 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:28:55 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:28:55 user nova-compute[74739]:     </rng>
Oct 25 18:28:55 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:28:55 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:28:55 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:28:55 user nova-compute[74739]:     </memballoon>
Oct 25 18:28:55 user nova-compute[74739]:   </devices>
Oct 25 18:28:55 user nova-compute[74739]: </domain>
Oct 25 18:28:55 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-544011779',display_name='tempest-AttachVolumeNegativeTest-server-544011779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-544011779',id=48,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHtMJn4mpj1AUHrAGfDk1mBc3mI1oKNDZ3y7RjHX4+WT+ISDOf2WRVYVKKxjTHxvf9fCXYtyQN7kz7T7tonXzg6FMAKZlD5D0aVMVCbYU4RwEW7c2mSsfQruBwHwhlRUQ==',key_name='tempest-keypair-522084488',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-ll4l6ctx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=57e36e88-8925-4ac1-975e-87847ec6b566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG os_vif [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a27d6ff-50b5-5bed-9d8a-9d770646961c', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d1588f2-cc, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d1588f2-cc, col_values=(('qos', UUID('b2064de0-eab6-4d51-9aba-13c4b915a7bc')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d1588f2-cc, col_values=(('external_ids', {'iface-id': '3d1588f2-cc4c-4ac3-b829-0ef5babd382f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:78:aa', 'vm-uuid': '57e36e88-8925-4ac1-975e-87847ec6b566'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:55 user nova-compute[74739]: INFO os_vif [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc')
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:47:78:aa, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.neutron [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updated VIF entry in instance network info cache for port 3d1588f2-cc4c-4ac3-b829-0ef5babd382f. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG nova.network.neutron [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:28:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e3bbfb9a-4d3c-4313-ba5a-b1e819c28ec9 req-ca9a6561-b483-4680-a45a-e9055dd94a62 service nova] Releasing lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:56 user nova-compute[74739]: DEBUG nova.compute.manager [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] No waiting events found dispatching network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:28:56 user nova-compute[74739]: WARNING nova.compute.manager [req-86a7a56c-3dfe-41dd-b515-e106b93bcc73 req-7c98652c-9483-4d0e-b642-7e528b2addfb service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received unexpected event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f for instance with vm_state building and task_state spawning.
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:28:58 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Instance spawned successfully.
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:28:58 user nova-compute[74739]: INFO nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 25 18:28:58 user nova-compute[74739]: DEBUG nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:28:59 user nova-compute[74739]: INFO nova.compute.manager [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Took 6.25 seconds to build instance.
Oct 25 18:28:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-94317716-1e61-4da2-8eb5-7cba19acd334 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.338s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:28:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:28:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:28:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:28:59 user nova-compute[74739]: DEBUG nova.compute.manager [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] No waiting events found dispatching network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:28:59 user nova-compute[74739]: WARNING nova.compute.manager [req-e7af7277-4179-4325-9341-69b21afb37dd req-2bae3d20-5471-43cf-9097-118a898bb19d service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received unexpected event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f for instance with vm_state active and task_state None.
Oct 25 18:29:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:01 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:29:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:29:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:29:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:27 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:29:31 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:29:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:29:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:29:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:29:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:29:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:29:39 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:29:40 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:29:41 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:29:41 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.929733276367188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 57e36e88-8925-4ac1-975e-87847ec6b566 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:29:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:29:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:29:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:29:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:29:55 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:05 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:10 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:15 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:30:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:28 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:30 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:30:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:30:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:30:33 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:30:34 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:30:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:30:34 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:30:35 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:40 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:30:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:30:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:30:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:30:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.92919158935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 57e36e88-8925-4ac1-975e-87847ec6b566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-changed-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.compute.manager [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Refreshing instance network info cache due to event network-changed-3d1588f2-cc4c-4ac3-b829-0ef5babd382f. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] Acquiring lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] Acquired lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:30:43 user nova-compute[74739]: DEBUG nova.network.neutron [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Refreshing network info cache for port 3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:44 user nova-compute[74739]: INFO nova.compute.manager [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Terminating instance
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.network.neutron [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updated VIF entry in instance network info cache for port 3d1588f2-cc4c-4ac3-b829-0ef5babd382f. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.network.neutron [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [{"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-74b88a28-e99b-420a-ac8e-b34d82ff83d6 req-5eec29d1-3585-466c-844a-1c57d85785df service nova] Releasing lock "refresh_cache-57e36e88-8925-4ac1-975e-87847ec6b566" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-unplugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] No waiting events found dispatching network-vif-unplugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-9bc317cb-0e02-48fc-9526-1170a47daf1b req-ea035db2-4c0c-42e7-8824-a3de1a7a9907 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-unplugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Instance destroyed successfully.
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'resources' on Instance uuid 57e36e88-8925-4ac1-975e-87847ec6b566 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:28:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-544011779',display_name='tempest-AttachVolumeNegativeTest-server-544011779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-544011779',id=48,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHtMJn4mpj1AUHrAGfDk1mBc3mI1oKNDZ3y7RjHX4+WT+ISDOf2WRVYVKKxjTHxvf9fCXYtyQN7kz7T7tonXzg6FMAKZlD5D0aVMVCbYU4RwEW7c2mSsfQruBwHwhlRUQ==',key_name='tempest-keypair-522084488',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:28:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-ll4l6ctx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=57e36e88-8925-4ac1-975e-87847ec6b566,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "address": "fa:16:3e:47:78:aa", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d1588f2-cc", "ovs_interfaceid": "3d1588f2-cc4c-4ac3-b829-0ef5babd382f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG os_vif [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d1588f2-cc, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2064de0-eab6-4d51-9aba-13c4b915a7bc) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:44 user nova-compute[74739]: INFO os_vif [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:78:aa,bridge_name='br-int',has_traffic_filtering=True,id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d1588f2-cc')
Oct 25 18:30:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Deleting instance files /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566_del
Oct 25 18:30:44 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Deletion of /opt/stack/data/nova/instances/57e36e88-8925-4ac1-975e-87847ec6b566_del complete
Oct 25 18:30:44 user nova-compute[74739]: INFO nova.compute.manager [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 25 18:30:44 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:30:44 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:30:45 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Took 0.59 seconds to deallocate network for instance.
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-14d3a4bb-f287-4818-9a51-3a3b496bceeb req-ef250a9f-2177-4729-b5dc-319e0ad710b4 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-deleted-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:30:45 user nova-compute[74739]: INFO nova.compute.manager [req-14d3a4bb-f287-4818-9a51-3a3b496bceeb req-ef250a9f-2177-4729-b5dc-319e0ad710b4 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Neutron deleted interface 3d1588f2-cc4c-4ac3-b829-0ef5babd382f; detaching it from the instance and deleting it from the info cache
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.network.neutron [req-14d3a4bb-f287-4818-9a51-3a3b496bceeb req-ef250a9f-2177-4729-b5dc-319e0ad710b4 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.compute.manager [req-14d3a4bb-f287-4818-9a51-3a3b496bceeb req-ef250a9f-2177-4729-b5dc-319e0ad710b4 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Detach interface failed, port_id=3d1588f2-cc4c-4ac3-b829-0ef5babd382f, reason: Instance 57e36e88-8925-4ac1-975e-87847ec6b566 could not be found. {{(pid=74739) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:30:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:45 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Deleted allocations for instance 57e36e88-8925-4ac1-975e-87847ec6b566
Oct 25 18:30:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-57cf0a7f-c8e7-4c76-a678-bf94e9adc88f tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "57e36e88-8925-4ac1-975e-87847ec6b566" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.562s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] Acquiring lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] Lock "57e36e88-8925-4ac1-975e-87847ec6b566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:30:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] No waiting events found dispatching network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:30:46 user nova-compute[74739]: WARNING nova.compute.manager [req-39c52797-70f7-48fb-8b6b-4b85e2e94859 req-caddbf26-f567-49f0-b159-15d85f516247 service nova] [instance: 57e36e88-8925-4ac1-975e-87847ec6b566] Received unexpected event network-vif-plugged-3d1588f2-cc4c-4ac3-b829-0ef5babd382f for instance with vm_state deleted and task_state None.
Oct 25 18:30:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:30:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:30:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:30:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:29 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:31:35 user nova-compute[74739]: INFO nova.compute.manager [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Detaching volume 5f87085e-c249-4396-a23e-afb450b84805
Oct 25 18:31:35 user nova-compute[74739]: INFO nova.virt.block_device [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Attempting to driver detach volume 5f87085e-c249-4396-a23e-afb450b84805 from mountpoint /dev/vdb
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Attempting to detach device vdb from instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:31:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:31:35 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:31:35 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:31:35 user nova-compute[74739]:   <serial>5f87085e-c249-4396-a23e-afb450b84805</serial>
Oct 25 18:31:35 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:31:35 user nova-compute[74739]: </disk>
Oct 25 18:31:35 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:31:35 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab from the persistent domain config.
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:31:35 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:31:35 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:31:35 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:31:35 user nova-compute[74739]:   <serial>5f87085e-c249-4396-a23e-afb450b84805</serial>
Oct 25 18:31:35 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:31:35 user nova-compute[74739]: </disk>
Oct 25 18:31:35 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:31:35 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:31:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:31:36 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [{"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:31:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:31:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:31:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:31:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:31:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=24.956180572509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:31:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:31:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:31:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:31:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:31:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:31:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab is timed out.
Oct 25 18:31:56 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab from the live domain config.
Oct 25 18:31:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qsQeciSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:31:56 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba5d11-29f9-4a38-bccf-e4a39e1f3e9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:31:56 user nova-compute[74739]: No targets found.
Oct 25 18:31:56 user nova-compute[74739]: iSNS:
Oct 25 18:31:56 user nova-compute[74739]: No targets found.
Oct 25 18:31:56 user nova-compute[74739]: STATIC:
Oct 25 18:31:56 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805
Oct 25 18:31:56 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:31:56 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:31:56 user nova-compute[74739]: FIRMWARE:
Oct 25 18:31:56 user nova-compute[74739]: No targets found.
Oct 25 18:31:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:31:56 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:31:56 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdad48f0-7d55-46b4-a390-7474f7e0bce6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1708882-9ca4-41fb-bde1-b2fe03fdc064]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)
Oct 25 18:31:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 (non-flash)
Oct 25 18:31:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc32eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f9950d-e9e8-4c31-95f2-b0a3a32dd9a1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2dbe69-0e20-4d6c-94c7-4cc4dfae8b93]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[38445bed-a982-4beb-9c27-fb7d2d455bcf]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[395f3f8f-7b1b-4da0-b15f-e5d02fe4ef35]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf57ec-a5a6-4b87-8460-7e464d6d88b9]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba788ce4-bcf0-4998-9e25-efd99de94c78]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260]
Oct 25 18:31:56 user nova-compute[74739]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805, portal: 172.16.0.220,3260] successful.
Oct 25 18:31:56 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f87085e-c249-4396-a23e-afb450b84805 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b1baf-0ae0-4f51-b44b-c2a1d277af35]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== disconnect_volume: return (260ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:31:56 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:31:57 user nova-compute[74739]: DEBUG nova.objects.instance [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:31:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb669909-5a62-4781-a7cf-858e701758c1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.645s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:31:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:25 user nova-compute[74739]: INFO nova.compute.manager [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Terminating instance
Oct 25 18:32:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:25 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-unplugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] No waiting events found dispatching network-vif-unplugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-4551ad06-b658-460c-bc17-b67489d76a61 req-fc428b8f-eb1c-49e5-ad9d-afe2432e72f7 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-unplugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Instance destroyed successfully.
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.objects.instance [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'resources' on Instance uuid d2f9cc63-ec2e-4b14-8719-3b70c01e62ab {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-319818817',display_name='tempest-AttachVolumeNegativeTest-server-319818817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-319818817',id=47,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2gHm5vls2sZBEIgJlnnlnuyNQcGdUaw4WQBnWDME/tT2AjRNiULbBsczF0zUaui212sXEGKoRDwCAE9bMJdEL8brM0XOEpgY2Bkxz43mRMx6C5KMyXAzMo11q5MvjMgg==',key_name='tempest-keypair-768063147',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:26:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-29ux8ga1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=d2f9cc63-ec2e-4b14-8719-3b70c01e62ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "address": "fa:16:3e:6c:9c:66", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97befbd9-df", "ovs_interfaceid": "97befbd9-dfd6-4046-bd50-f4fea1c1e571", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG os_vif [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97befbd9-df, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1897bcf7-3f8f-415a-b32e-1ef647250752) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:26 user nova-compute[74739]: INFO os_vif [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:9c:66,bridge_name='br-int',has_traffic_filtering=True,id=97befbd9-dfd6-4046-bd50-f4fea1c1e571,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97befbd9-df')
Oct 25 18:32:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Deleting instance files /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab_del
Oct 25 18:32:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Deletion of /opt/stack/data/nova/instances/d2f9cc63-ec2e-4b14-8719-3b70c01e62ab_del complete
Oct 25 18:32:26 user nova-compute[74739]: INFO nova.compute.manager [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 25 18:32:26 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:32:26 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:32:27 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:32:27 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Took 0.57 seconds to deallocate network for instance.
Oct 25 18:32:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:27 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:32:27 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:32:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:27 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Deleted allocations for instance d2f9cc63-ec2e-4b14-8719-3b70c01e62ab
Oct 25 18:32:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-cb0836b6-9ffa-4790-b129-e49bde62f750 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.762s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:32:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] Acquiring lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:28 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] Lock "d2f9cc63-ec2e-4b14-8719-3b70c01e62ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] No waiting events found dispatching network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:32:28 user nova-compute[74739]: WARNING nova.compute.manager [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received unexpected event network-vif-plugged-97befbd9-dfd6-4046-bd50-f4fea1c1e571 for instance with vm_state deleted and task_state None.
Oct 25 18:32:28 user nova-compute[74739]: DEBUG nova.compute.manager [req-e525b88e-9091-4177-87ba-42837cfd07e6 req-17928e0f-420d-4b31-9fa5-d1c3e6744d93 service nova] [instance: d2f9cc63-ec2e-4b14-8719-3b70c01e62ab] Received event network-vif-deleted-97befbd9-dfd6-4046-bd50-f4fea1c1e571 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:32:30 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:32:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:32:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:32:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:32:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:32:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=24.98340606689453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:32:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:32:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:32:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:32:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:32:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:32:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:33:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:33:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:20 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:33:20 user nova-compute[74739]: INFO nova.compute.claims [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Claim successful on node user
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:33:21 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.policy [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7655943dc394a63b416a6817e27a5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da7cca5578f464eb82b3b8ddf64b92f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:33:21 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Creating image(s)
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk 1073741824" returned: 0 in 0.049s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Successfully created port: dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.169s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:33:21 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Cannot resize image /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Ensure instance console log exists: /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Successfully updated port: dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-changed-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.compute.manager [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Refreshing instance network info cache due to event network-changed-dde78870-322f-4683-b59a-8e551441ce82. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.network.neutron [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Instance network_info: |[{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Refreshing network info cache for port dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Start _get_guest_xml network_info=[{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:33:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:33:22 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:33:22 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1403907816',display_name='tempest-AttachVolumeNegativeTest-server-1403907816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1403907816',id=49,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/h6QbFGcAjdm2p6T6Hacmb2a5Us6l/Un0UdVtgAvI2E1VT24RJTqDTrmCy+CosJKt3e0WnFLbC3CDIKbTbw6I7WgkAl7G5fzZcfQBYZJw/s1CXVumdKxceLpSI5NjHQ==',key_name='tempest-keypair-1208329263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-5vzs2a5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=c9f8d54a-467d-4490-91e3-d1802181457a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'pci_devices' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:33:23 user nova-compute[74739]:   <uuid>c9f8d54a-467d-4490-91e3-d1802181457a</uuid>
Oct 25 18:33:23 user nova-compute[74739]:   <name>instance-00000031</name>
Oct 25 18:33:23 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:33:23 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:33:23 user nova-compute[74739]:   <metadata>
Oct 25 18:33:23 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:33:23 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1403907816</nova:name>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:33:22</nova:creationTime>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:33:23 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:33:23 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:owner>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:user uuid="b7655943dc394a63b416a6817e27a5de">tempest-AttachVolumeNegativeTest-698356987-project-member</nova:user>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:project uuid="3da7cca5578f464eb82b3b8ddf64b92f">tempest-AttachVolumeNegativeTest-698356987</nova:project>
Oct 25 18:33:23 user nova-compute[74739]:       </nova:owner>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:33:23 user nova-compute[74739]:       <nova:ports>
Oct 25 18:33:23 user nova-compute[74739]:         <nova:port uuid="dde78870-322f-4683-b59a-8e551441ce82">
Oct 25 18:33:23 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 25 18:33:23 user nova-compute[74739]:         </nova:port>
Oct 25 18:33:23 user nova-compute[74739]:       </nova:ports>
Oct 25 18:33:23 user nova-compute[74739]:     </nova:instance>
Oct 25 18:33:23 user nova-compute[74739]:   </metadata>
Oct 25 18:33:23 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:33:23 user nova-compute[74739]:     <system>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="serial">c9f8d54a-467d-4490-91e3-d1802181457a</entry>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="uuid">c9f8d54a-467d-4490-91e3-d1802181457a</entry>
Oct 25 18:33:23 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:33:23 user nova-compute[74739]:     </system>
Oct 25 18:33:23 user nova-compute[74739]:   </sysinfo>
Oct 25 18:33:23 user nova-compute[74739]:   <os>
Oct 25 18:33:23 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:33:23 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:33:23 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:33:23 user nova-compute[74739]:   </os>
Oct 25 18:33:23 user nova-compute[74739]:   <features>
Oct 25 18:33:23 user nova-compute[74739]:     <acpi/>
Oct 25 18:33:23 user nova-compute[74739]:     <apic/>
Oct 25 18:33:23 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:33:23 user nova-compute[74739]:   </features>
Oct 25 18:33:23 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:33:23 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:33:23 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:33:23 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:33:23 user nova-compute[74739]:   </clock>
Oct 25 18:33:23 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:33:23 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:33:23 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:33:23 user nova-compute[74739]:   </cpu>
Oct 25 18:33:23 user nova-compute[74739]:   <devices>
Oct 25 18:33:23 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:33:23 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:33:23 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk"/>
Oct 25 18:33:23 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:33:23 user nova-compute[74739]:     </disk>
Oct 25 18:33:23 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:33:23 user nova-compute[74739]:       <mac address="fa:16:3e:b0:24:76"/>
Oct 25 18:33:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:33:23 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:33:23 user nova-compute[74739]:       <target dev="tapdde78870-32"/>
Oct 25 18:33:23 user nova-compute[74739]:     </interface>
Oct 25 18:33:23 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:33:23 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/console.log" append="off"/>
Oct 25 18:33:23 user nova-compute[74739]:     </serial>
Oct 25 18:33:23 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:33:23 user nova-compute[74739]:     <video>
Oct 25 18:33:23 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:33:23 user nova-compute[74739]:     </video>
Oct 25 18:33:23 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:33:23 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:33:23 user nova-compute[74739]:     </rng>
Oct 25 18:33:23 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:33:23 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:33:23 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:33:23 user nova-compute[74739]:     </memballoon>
Oct 25 18:33:23 user nova-compute[74739]:   </devices>
Oct 25 18:33:23 user nova-compute[74739]: </domain>
Oct 25 18:33:23 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1403907816',display_name='tempest-AttachVolumeNegativeTest-server-1403907816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1403907816',id=49,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/h6QbFGcAjdm2p6T6Hacmb2a5Us6l/Un0UdVtgAvI2E1VT24RJTqDTrmCy+CosJKt3e0WnFLbC3CDIKbTbw6I7WgkAl7G5fzZcfQBYZJw/s1CXVumdKxceLpSI5NjHQ==',key_name='tempest-keypair-1208329263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-5vzs2a5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=c9f8d54a-467d-4490-91e3-d1802181457a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG os_vif [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd293ec55-278d-582b-ab85-70deb824a481', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdde78870-32, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdde78870-32, col_values=(('qos', UUID('782c56a2-efeb-468f-98ed-9ff0edfc0339')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdde78870-32, col_values=(('external_ids', {'iface-id': 'dde78870-322f-4683-b59a-8e551441ce82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:24:76', 'vm-uuid': 'c9f8d54a-467d-4490-91e3-d1802181457a'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:23 user nova-compute[74739]: INFO os_vif [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32')
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:b0:24:76, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updated VIF entry in instance network info cache for port dde78870-322f-4683-b59a-8e551441ce82. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG nova.network.neutron [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:33:23 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-72eb4132-fcc1-4e95-9f31-b12a809f2a1a req-f4e5db45-fb4c-45c3-b8fd-9643407b2a33 service nova] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG nova.compute.manager [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] No waiting events found dispatching network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:33:24 user nova-compute[74739]: WARNING nova.compute.manager [req-e4920a20-a8e7-41a4-9cd7-96ff65e84912 req-d819d6d5-42ce-4711-8470-dc7a0cae76e8 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received unexpected event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 for instance with vm_state building and task_state spawning.
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:33:26 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Instance spawned successfully.
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:33:26 user nova-compute[74739]: INFO nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:26 user nova-compute[74739]: DEBUG nova.compute.manager [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] No waiting events found dispatching network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:33:26 user nova-compute[74739]: WARNING nova.compute.manager [req-b7f2b1ae-d30c-4292-be73-f40091b9310f req-4027d023-146d-4efb-84e5-4807d5508fea service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received unexpected event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 for instance with vm_state building and task_state spawning.
Oct 25 18:33:26 user nova-compute[74739]: INFO nova.compute.manager [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Took 5.66 seconds to build instance.
Oct 25 18:33:26 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f6424832-b090-4241-8782-e3a68aa50253 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.753s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:32 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:38 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:33:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:33:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:33:41 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:33:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:33:42 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:33:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.955371856689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c9f8d54a-467d-4490-91e3-d1802181457a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:33:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:33:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Triggering sync for uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 25 18:33:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:33:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:33:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:33:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:33:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:33:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:33:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:33:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:33:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:34:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:11 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:34:40 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:34:41 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:34:41 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:34:41 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:34:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:34:42 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:34:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:34:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.953109741210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c9f8d54a-467d-4490-91e3-d1802181457a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:34:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:34:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:34:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:34:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:34:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:35:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-changed-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:35:11 user nova-compute[74739]: DEBUG nova.compute.manager [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Refreshing instance network info cache due to event network-changed-dde78870-322f-4683-b59a-8e551441ce82. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:35:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:35:11 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:35:11 user nova-compute[74739]: DEBUG nova.network.neutron [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Refreshing network info cache for port dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:35:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updated VIF entry in instance network info cache for port dde78870-322f-4683-b59a-8e551441ce82. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:35:12 user nova-compute[74739]: DEBUG nova.network.neutron [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:35:12 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-5aecaed7-9f8a-40e7-81fc-552e982227a6 req-94deef60-bead-473c-8774-8d65082d98b0 service nova] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:35:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG nova.objects.instance [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:35:17 user nova-compute[74739]: INFO nova.compute.manager [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Attaching volume ddb8b73b-f921-44e6-86f2-1f2379a21877 to /dev/vdb
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ea9a33-3874-4b51-a8ce-81bfa9d0e80b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca6b53-ab51-4e3c-87f9-4637d45d3253]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecedf06-db24-4ee1-840e-52a4380bb11d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13e3ec0-6d16-4605-a4ac-0255b140c3fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:35:17 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:35:17 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c211db-37d1-4737-9450-74384e171340]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG os_brick.utils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:35:17 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating existing volume attachment record: 161cba09-5341-41f6-baeb-d890370ca058 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:35:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:35 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:35:42 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [{"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-c9f8d54a-467d-4490-91e3-d1802181457a" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cralmyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:35:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:35:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:35:43 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8326dd58-33ca-4c9b-9c86-ff5953a0de9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:35:43 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f13e9dd-2cdb-4b4f-8ecd-e3ae2d63866c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877] added
Oct 25 18:35:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e44fe8-7a39-48c5-ab70-3dd0a3f80306]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac343a-ce7a-43de-ad7f-35e2abb48a76]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cralmyJd {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cralmyJd" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650256d-2dab-432d-95e7-6bee78925817]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cralmyJd'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5289dd83-1178-4fd7-9fcf-cc5a79ea0320]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9733d0ba-a5b8-41f1-a086-5ecd562677cb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:35:43 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:35:43 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:35:43 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:35:43 user nova-compute[74739]: 
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebd472-6276-4cf9-90fd-cd18ccf87161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260]
Oct 25 18:35:43 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260] successful.
Oct 25 18:35:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4bdb6d-9611-490a-9f5b-3b2b9ed94855]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[16acc8dc-d8c5-4c9f-8bf9-fc092dc7f72a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)
Oct 25 18:35:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)
Oct 25 18:35:43 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[745dd308-77e2-41f0-a280-1ef031ec829a]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:35:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:35:44 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:35:44 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=24.952159881591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance c9f8d54a-467d-4490-91e3-d1802181457a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cralmyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23833323366313833', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833323366313833', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:35:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:35:44 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:35:44 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:35:44 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:35:44 user nova-compute[74739]:   <serial>ddb8b73b-f921-44e6-86f2-1f2379a21877</serial>
Oct 25 18:35:44 user nova-compute[74739]: </disk>
Oct 25 18:35:44 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:b0:24:76, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-15609420-88f6-41bb-90bc-c513e2fd0f0e tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.678s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:35:45 user nova-compute[74739]: INFO nova.compute.manager [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Detaching volume ddb8b73b-f921-44e6-86f2-1f2379a21877
Oct 25 18:35:45 user nova-compute[74739]: INFO nova.virt.block_device [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Attempting to driver detach volume ddb8b73b-f921-44e6-86f2-1f2379a21877 from mountpoint /dev/vdb
Oct 25 18:35:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Attempting to detach device vdb from instance c9f8d54a-467d-4490-91e3-d1802181457a from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:35:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:35:45 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:35:45 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:35:45 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:35:45 user nova-compute[74739]:   <serial>ddb8b73b-f921-44e6-86f2-1f2379a21877</serial>
Oct 25 18:35:45 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:35:45 user nova-compute[74739]: </disk>
Oct 25 18:35:45 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:35:46 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance c9f8d54a-467d-4490-91e3-d1802181457a from the persistent domain config.
Oct 25 18:35:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9f8d54a-467d-4490-91e3-d1802181457a from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:35:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:35:46 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:35:46 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:35:46 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:35:46 user nova-compute[74739]:   <serial>ddb8b73b-f921-44e6-86f2-1f2379a21877</serial>
Oct 25 18:35:46 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:35:46 user nova-compute[74739]: </disk>
Oct 25 18:35:46 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:35:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:35:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:35:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:35:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:35:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:35:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:06 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9f8d54a-467d-4490-91e3-d1802181457a is timed out.
Oct 25 18:36:06 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance c9f8d54a-467d-4490-91e3-d1802181457a from the live domain config.
Oct 25 18:36:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cralmyJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:36:06 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453dc27-e452-455f-bbce-fc3021d20b55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:36:06 user nova-compute[74739]: No targets found.
Oct 25 18:36:06 user nova-compute[74739]: iSNS:
Oct 25 18:36:06 user nova-compute[74739]: No targets found.
Oct 25 18:36:06 user nova-compute[74739]: STATIC:
Oct 25 18:36:06 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877
Oct 25 18:36:06 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:36:06 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:36:06 user nova-compute[74739]: FIRMWARE:
Oct 25 18:36:06 user nova-compute[74739]: No targets found.
Oct 25 18:36:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:36:06 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:36:06 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8055b617-e5f9-42fc-b1b6-2bb51121e1df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[faed4266-ec02-47ee-9d32-be180310159b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)
Oct 25 18:36:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 (non-flash)
Oct 25 18:36:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc193be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d3a70c-ed0c-49e4-9cef-7e404e71628a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f4d878-bf2c-4e3b-8691-72a63ac2e758]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[0143bc58-ca76-4258-8b45-af61cc8b7499]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95b35c-04bf-4987-a159-29425814ddc1]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7367a45-9666-42be-a13f-96a25acf604b]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[993eb817-a620-4b80-919e-8c75c6a81a44]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260]
Oct 25 18:36:06 user nova-compute[74739]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877, portal: 172.16.0.220,3260] successful.
Oct 25 18:36:06 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddb8b73b-f921-44e6-86f2-1f2379a21877 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[016280d8-384f-480e-a085-0207b3250fe5]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== disconnect_volume: return (285ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:36:06 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:36:07 user nova-compute[74739]: DEBUG nova.objects.instance [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:36:07 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-09b9253d-4340-4a6f-bd62-5f9b0b18d779 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.681s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:36 user nova-compute[74739]: INFO nova.compute.manager [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Terminating instance
Oct 25 18:36:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-unplugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] No waiting events found dispatching network-vif-unplugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG nova.compute.manager [req-0dd3ad9c-d5ff-46bf-9e30-7e90da6264d7 req-e0155b2c-26b1-4219-bf42-088d39a6ef23 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-unplugged-dde78870-322f-4683-b59a-8e551441ce82 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:36:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Instance destroyed successfully.
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.objects.instance [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'resources' on Instance uuid c9f8d54a-467d-4490-91e3-d1802181457a {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1403907816',display_name='tempest-AttachVolumeNegativeTest-server-1403907816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1403907816',id=49,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOy/h6QbFGcAjdm2p6T6Hacmb2a5Us6l/Un0UdVtgAvI2E1VT24RJTqDTrmCy+CosJKt3e0WnFLbC3CDIKbTbw6I7WgkAl7G5fzZcfQBYZJw/s1CXVumdKxceLpSI5NjHQ==',key_name='tempest-keypair-1208329263',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-5vzs2a5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=c9f8d54a-467d-4490-91e3-d1802181457a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "dde78870-322f-4683-b59a-8e551441ce82", "address": "fa:16:3e:b0:24:76", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdde78870-32", "ovs_interfaceid": "dde78870-322f-4683-b59a-8e551441ce82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG os_vif [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdde78870-32, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=782c56a2-efeb-468f-98ed-9ff0edfc0339) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:37 user nova-compute[74739]: INFO os_vif [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:24:76,bridge_name='br-int',has_traffic_filtering=True,id=dde78870-322f-4683-b59a-8e551441ce82,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdde78870-32')
Oct 25 18:36:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Deleting instance files /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a_del
Oct 25 18:36:37 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Deletion of /opt/stack/data/nova/instances/c9f8d54a-467d-4490-91e3-d1802181457a_del complete
Oct 25 18:36:37 user nova-compute[74739]: INFO nova.compute.manager [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 25 18:36:37 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:36:37 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Took 0.76 seconds to deallocate network for instance.
Oct 25 18:36:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:37 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-15bc05df-d73f-4e57-846a-cb8621d8f502 req-78601042-fef4-4af2-b526-4cc09990b7c5 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-deleted-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:38 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Deleted allocations for instance c9f8d54a-467d-4490-91e3-d1802181457a
Oct 25 18:36:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-16e2661a-8fec-4534-931b-f17e9489852b tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "c9f8d54a-467d-4490-91e3-d1802181457a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] Acquiring lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] Lock "c9f8d54a-467d-4490-91e3-d1802181457a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] No waiting events found dispatching network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:36:38 user nova-compute[74739]: WARNING nova.compute.manager [req-4948bd6e-f220-4b07-8216-a9e8cdf01854 req-16f720f9-4b70-468f-81a0-a40f16e04be2 service nova] [instance: c9f8d54a-467d-4490-91e3-d1802181457a] Received unexpected event network-vif-plugged-dde78870-322f-4683-b59a-8e551441ce82 for instance with vm_state deleted and task_state None.
Oct 25 18:36:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:42 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:36:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:36:43 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9157MB free_disk=24.971397399902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:36:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:36:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:36:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:36:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:36:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:36:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:36:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:36:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:36:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:36:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:37:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:37:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:30 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:37:30 user nova-compute[74739]: INFO nova.compute.claims [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Claim successful on node user
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:37:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.policy [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7655943dc394a63b416a6817e27a5de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da7cca5578f464eb82b3b8ddf64b92f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:37:31 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Creating image(s)
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "/opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "/opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.198s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk 1073741824" returned: 0 in 0.048s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Successfully created port: 1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:37:31 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Cannot resize image /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Ensure instance console log exists: /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Successfully updated port: 1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-changed-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.compute.manager [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Refreshing instance network info cache due to event network-changed-1f577d31-5678-44d1-85b7-f2da2efd8b61. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.neutron [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Instance network_info: |[{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.neutron [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Refreshing network info cache for port 1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Start _get_guest_xml network_info=[{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:37:32 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:37:32 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1165697054',display_name='tempest-AttachVolumeNegativeTest-server-1165697054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1165697054',id=50,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC9TfoLuzXVlbnY8RBYk6v1T874sNvUkMLvaxN656fR+hO0dtMyBkPCL0q+2rXlUR5CYOZfN8zNYrfC1VOi4Mn4Tz6m39Jx09oKTDMk8uEXIMw/6cGKNBnss0jPzm69dQ==',key_name='tempest-keypair-308630588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-k55pphwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=60469b9c-ba4c-459b-bb52-12a82d2baffe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.objects.instance [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'pci_devices' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:37:32 user nova-compute[74739]:   <uuid>60469b9c-ba4c-459b-bb52-12a82d2baffe</uuid>
Oct 25 18:37:32 user nova-compute[74739]:   <name>instance-00000032</name>
Oct 25 18:37:32 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:37:32 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:37:32 user nova-compute[74739]:   <metadata>
Oct 25 18:37:32 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:37:32 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1165697054</nova:name>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:37:32</nova:creationTime>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:37:32 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:37:32 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:owner>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:user uuid="b7655943dc394a63b416a6817e27a5de">tempest-AttachVolumeNegativeTest-698356987-project-member</nova:user>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:project uuid="3da7cca5578f464eb82b3b8ddf64b92f">tempest-AttachVolumeNegativeTest-698356987</nova:project>
Oct 25 18:37:32 user nova-compute[74739]:       </nova:owner>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:37:32 user nova-compute[74739]:       <nova:ports>
Oct 25 18:37:32 user nova-compute[74739]:         <nova:port uuid="1f577d31-5678-44d1-85b7-f2da2efd8b61">
Oct 25 18:37:32 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 18:37:32 user nova-compute[74739]:         </nova:port>
Oct 25 18:37:32 user nova-compute[74739]:       </nova:ports>
Oct 25 18:37:32 user nova-compute[74739]:     </nova:instance>
Oct 25 18:37:32 user nova-compute[74739]:   </metadata>
Oct 25 18:37:32 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:37:32 user nova-compute[74739]:     <system>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="serial">60469b9c-ba4c-459b-bb52-12a82d2baffe</entry>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="uuid">60469b9c-ba4c-459b-bb52-12a82d2baffe</entry>
Oct 25 18:37:32 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:37:32 user nova-compute[74739]:     </system>
Oct 25 18:37:32 user nova-compute[74739]:   </sysinfo>
Oct 25 18:37:32 user nova-compute[74739]:   <os>
Oct 25 18:37:32 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:37:32 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:37:32 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:37:32 user nova-compute[74739]:   </os>
Oct 25 18:37:32 user nova-compute[74739]:   <features>
Oct 25 18:37:32 user nova-compute[74739]:     <acpi/>
Oct 25 18:37:32 user nova-compute[74739]:     <apic/>
Oct 25 18:37:32 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:37:32 user nova-compute[74739]:   </features>
Oct 25 18:37:32 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:37:32 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:37:32 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:37:32 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:37:32 user nova-compute[74739]:   </clock>
Oct 25 18:37:32 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:37:32 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:37:32 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:37:32 user nova-compute[74739]:   </cpu>
Oct 25 18:37:32 user nova-compute[74739]:   <devices>
Oct 25 18:37:32 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:37:32 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:37:32 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk"/>
Oct 25 18:37:32 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:37:32 user nova-compute[74739]:     </disk>
Oct 25 18:37:32 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:37:32 user nova-compute[74739]:       <mac address="fa:16:3e:4a:89:09"/>
Oct 25 18:37:32 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:37:32 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:37:32 user nova-compute[74739]:       <target dev="tap1f577d31-56"/>
Oct 25 18:37:32 user nova-compute[74739]:     </interface>
Oct 25 18:37:32 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:37:32 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/console.log" append="off"/>
Oct 25 18:37:32 user nova-compute[74739]:     </serial>
Oct 25 18:37:32 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:37:32 user nova-compute[74739]:     <video>
Oct 25 18:37:32 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:37:32 user nova-compute[74739]:     </video>
Oct 25 18:37:32 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:37:32 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:37:32 user nova-compute[74739]:     </rng>
Oct 25 18:37:32 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:37:32 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:37:32 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:37:32 user nova-compute[74739]:     </memballoon>
Oct 25 18:37:32 user nova-compute[74739]:   </devices>
Oct 25 18:37:32 user nova-compute[74739]: </domain>
Oct 25 18:37:32 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1165697054',display_name='tempest-AttachVolumeNegativeTest-server-1165697054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1165697054',id=50,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC9TfoLuzXVlbnY8RBYk6v1T874sNvUkMLvaxN656fR+hO0dtMyBkPCL0q+2rXlUR5CYOZfN8zNYrfC1VOi4Mn4Tz6m39Jx09oKTDMk8uEXIMw/6cGKNBnss0jPzm69dQ==',key_name='tempest-keypair-308630588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-k55pphwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:37:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=60469b9c-ba4c-459b-bb52-12a82d2baffe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG os_vif [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54bf8da8-ccc1-5016-868a-d6832eeabbc4', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f577d31-56, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f577d31-56, col_values=(('qos', UUID('4702a229-8114-4514-9d57-093685604452')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f577d31-56, col_values=(('external_ids', {'iface-id': '1f577d31-5678-44d1-85b7-f2da2efd8b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:89:09', 'vm-uuid': '60469b9c-ba4c-459b-bb52-12a82d2baffe'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:32 user nova-compute[74739]: INFO os_vif [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56')
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:37:32 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:4a:89:09, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:37:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updated VIF entry in instance network info cache for port 1f577d31-5678-44d1-85b7-f2da2efd8b61. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:37:33 user nova-compute[74739]: DEBUG nova.network.neutron [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:37:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-c93f08bb-7006-4047-8039-316f65f9dfb1 req-d83a49a3-d4c0-4525-906b-a1263dc060b8 service nova] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:37:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] No waiting events found dispatching network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:37:34 user nova-compute[74739]: WARNING nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received unexpected event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 for instance with vm_state building and task_state spawning.
Oct 25 18:37:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] No waiting events found dispatching network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:37:34 user nova-compute[74739]: WARNING nova.compute.manager [req-7d57fc80-8356-4c77-acf0-bf300bc83cf8 req-ceaa6e8c-4eee-4eef-93fb-172570a1c743 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received unexpected event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 for instance with vm_state building and task_state spawning.
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:37:36 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Instance spawned successfully.
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:37:36 user nova-compute[74739]: INFO nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Took 5.03 seconds to spawn the instance on the hypervisor.
Oct 25 18:37:36 user nova-compute[74739]: DEBUG nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:37:36 user nova-compute[74739]: INFO nova.compute.manager [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Took 5.82 seconds to build instance.
Oct 25 18:37:36 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-5339da3c-b619-415c-ad42-b8f8a8e33c42 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.909s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:37:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:37:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:37:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.969463348388672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 60469b9c-ba4c-459b-bb52-12a82d2baffe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:37:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:37:46 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:37:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:37:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:37:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:37:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:37:55 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:37:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:37:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:38:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:33 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:38:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:38:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:38:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:38:45 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.94113540649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 60469b9c-ba4c-459b-bb52-12a82d2baffe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:38:45 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:38:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:38:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:38:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:38:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:38:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:39:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:39:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:39:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:39:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:15 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:39:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-changed-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:39:21 user nova-compute[74739]: DEBUG nova.compute.manager [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Refreshing instance network info cache due to event network-changed-1f577d31-5678-44d1-85b7-f2da2efd8b61. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:39:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:39:21 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:39:21 user nova-compute[74739]: DEBUG nova.network.neutron [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Refreshing network info cache for port 1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:39:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updated VIF entry in instance network info cache for port 1f577d31-5678-44d1-85b7-f2da2efd8b61. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:39:22 user nova-compute[74739]: DEBUG nova.network.neutron [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:39:22 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-dd29bab6-bd52-4652-96ca-9f7e7480d498 req-62301fb5-c03e-4464-a4c2-8fab318366de service nova] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:39:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:39:27 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:39:27 user nova-compute[74739]: INFO nova.compute.manager [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Attaching volume 61442205-2f2b-48bb-8d9b-9eec47603946 to /dev/vdb
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.utils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd0a5bf-9a40-4329-9851-f36f8127cca2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8520bb7eb\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c3809-8df6-46ce-9b38-1403bc96c425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5afa6d-aae0-4f1a-b09e-49c146c2705a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f73e3-5125-4708-9ab4-487117b49130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Running cmd (subprocess): nvme version {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] 'nvme version' failed. Not Retrying. {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] nvme not present on system {{(pid=74739) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 25 18:39:28 user nova-compute[74739]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 25 18:39:28 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[321504d7-b3aa-4d58-aa2f-135174ffc701]: (4, '') {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74739) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] LIGHTOS: no hostnqn found. {{(pid=74739) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG os_brick.utils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8520bb7eb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:39:28 user nova-compute[74739]: DEBUG nova.virt.block_device [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating existing volume attachment record: 491fb5bb-bffa-414f-b2d3-47eea894dff4 {{(pid=74739) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 25 18:39:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:40 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Calling os-brick to attach iSCSI Volume {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPeESkTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:39:44 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:39:44 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:39:44 user nova-compute[74739]: INFO os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9cee8e-9af1-470e-807e-b65a6150f48b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 25 18:39:44 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --interface default --op new {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb6cba-27b9-4afe-b245-0c9ee2f55700]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946] added\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946] added
Oct 25 18:39:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce9a5c-30bd-43e4-94b8-9cef9cd57cd4]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7fcdad-aa04-43c3-abf3-766d8f8635cb]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPeESkTY {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPeESkTY" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791c639-98d8-4318-a0b4-8648479cd546]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPeESkTY'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87bb187-381f-4bb7-b530-243e684359e6]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef9249-9ff0-4302-b5e9-f3bae38c1143]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:39:44 user nova-compute[74739]:  {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 25 18:39:44 user nova-compute[74739]:  {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:39:44 user nova-compute[74739]: WARNING os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 25 18:39:44 user nova-compute[74739]: 
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --login {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca1cd4f-1020-45e9-8d5d-753cc4f3a022]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260]
Oct 25 18:39:44 user nova-compute[74739]: Login to [iface: default, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260] successful.
Oct 25 18:39:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7098b0c-ef68-40ae-bd7e-25e486a59d74]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[885332b0-8827-439b-a1c0-c3e354fcd25d]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)
Oct 25 18:39:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)
Oct 25 18:39:44 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to 172.16.0.220:3260 {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74739) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74739) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f2950-d3e7-4f42-904c-0b6d032c3719]: (4, ('- - 0', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74739) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 25 18:39:44 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPeESkTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74739) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23235653263376636', 'path': '/dev/sdb'} {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653263376636', 'path': '/dev/sdb'} {{(pid=74739) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] attach device xml: <disk type="block" device="disk">
Oct 25 18:39:45 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:39:45 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:39:45 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:39:45 user nova-compute[74739]:   <serial>61442205-2f2b-48bb-8d9b-9eec47603946</serial>
Oct 25 18:39:45 user nova-compute[74739]: </disk>
Oct 25 18:39:45 user nova-compute[74739]:  {{(pid=74739) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:39:45 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] No VIF found with MAC fa:16:3e:4a:89:09, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-d2d654cc-d7e9-4ada-96d1-82ba6f158276 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.222s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [{"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-60469b9c-ba4c-459b-bb52-12a82d2baffe" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:39:46 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74739) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 25 18:39:47 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:39:47 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.940109252929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:39:47 user nova-compute[74739]: INFO nova.compute.manager [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Detaching volume 61442205-2f2b-48bb-8d9b-9eec47603946
Oct 25 18:39:47 user nova-compute[74739]: INFO nova.virt.block_device [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Attempting to driver detach volume 61442205-2f2b-48bb-8d9b-9eec47603946 from mountpoint /dev/vdb
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 60469b9c-ba4c-459b-bb52-12a82d2baffe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Attempting to detach device vdb from instance 60469b9c-ba4c-459b-bb52-12a82d2baffe from the persistent domain config. {{(pid=74739) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:39:47 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:39:47 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:39:47 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:39:47 user nova-compute[74739]:   <serial>61442205-2f2b-48bb-8d9b-9eec47603946</serial>
Oct 25 18:39:47 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:39:47 user nova-compute[74739]: </disk>
Oct 25 18:39:47 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:39:47 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance 60469b9c-ba4c-459b-bb52-12a82d2baffe from the persistent domain config.
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 60469b9c-ba4c-459b-bb52-12a82d2baffe from the live domain config. {{(pid=74739) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.guest [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] detach device xml: <disk type="block" device="disk">
Oct 25 18:39:47 user nova-compute[74739]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 25 18:39:47 user nova-compute[74739]:   <source dev="/dev/sdb"/>
Oct 25 18:39:47 user nova-compute[74739]:   <target dev="vdb" bus="virtio"/>
Oct 25 18:39:47 user nova-compute[74739]:   <serial>61442205-2f2b-48bb-8d9b-9eec47603946</serial>
Oct 25 18:39:47 user nova-compute[74739]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 25 18:39:47 user nova-compute[74739]: </disk>
Oct 25 18:39:47 user nova-compute[74739]:  {{(pid=74739) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:39:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:39:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 25 18:39:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:39:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:39:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:39:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:08 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 60469b9c-ba4c-459b-bb52-12a82d2baffe is timed out.
Oct 25 18:40:08 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully detached device vdb from instance 60469b9c-ba4c-459b-bb52-12a82d2baffe from the live domain config.
Oct 25 18:40:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] calling os-brick to detach iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd2dc7114b0>, {'target_iqn': 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPeESkTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 25 18:40:08 user nova-compute[74739]: WARNING os_brick.initiator.connectors.base [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f78117-e668-4557-ade9-bb767cf2420b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 25 18:40:08 user nova-compute[74739]: No targets found.
Oct 25 18:40:08 user nova-compute[74739]: iSNS:
Oct 25 18:40:08 user nova-compute[74739]: No targets found.
Oct 25 18:40:08 user nova-compute[74739]: STATIC:
Oct 25 18:40:08 user nova-compute[74739]: Target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946
Oct 25 18:40:08 user nova-compute[74739]:         Portal: 172.16.0.220:3260,-1
Oct 25 18:40:08 user nova-compute[74739]:                 Iface Name: default
Oct 25 18:40:08 user nova-compute[74739]: FIRMWARE:
Oct 25 18:40:08 user nova-compute[74739]: No targets found.
Oct 25 18:40:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 25 18:40:08 user nova-compute[74739]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 25 18:40:08 user nova-compute[74739]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74739) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946', 0)] {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d33973-ba42-49f7-ad84-1c48466d64fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d45ea72-d0fa-4b98-ae48-4d32927546ba]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)
Oct 25 18:40:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 (non-flash)
Oct 25 18:40:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd2dc3ba680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946'): ({'sdb'}, set())}) {{(pid=74739) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Removing single pathed devices sdb {{(pid=74739) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e723b-d508-4dde-bb6e-6f065b9b46c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760043a-ae6b-4971-833d-6ad5aa89302c]: (4, ('ok\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Flushing IO for device /dev/sdb {{(pid=74739) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c4980-b88c-4ed2-a6d9-35a2073f5b61]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74739) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7990d13-1f1f-4877-90e5-ba2a33324582]: (4, ('1', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.linuxscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] SCSI volumes sdb have been removed. {{(pid=74739) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946')] {{(pid=74739) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335c2b2-99af-4462-a46a-8a74e26849f8]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --logout {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[511d22fb-ce9a-4dfa-9234-8c6c1325399b]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260]
Oct 25 18:40:08 user nova-compute[74739]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946, portal: 172.16.0.220,3260] successful.
Oct 25 18:40:08 user nova-compute[74739]:  stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op delete {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61442205-2f2b-48bb-8d9b-9eec47603946 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86127) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5f5238-e454-4af1-a793-e66f978a701d]: (4, ('', '')) {{(pid=86127) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74739) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.base [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG os_brick.initiator.connectors.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] <== disconnect_volume: return (285ms) None {{(pid=74739) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 25 18:40:08 user nova-compute[74739]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Disconnected iSCSI Volume {{(pid=74739) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 25 18:40:09 user nova-compute[74739]: DEBUG nova.objects.instance [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'flavor' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:40:09 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-72aeeb62-0445-4446-80ce-7d2eb5095bf4 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:40:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:38 user nova-compute[74739]: INFO nova.compute.manager [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Terminating instance
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.compute.manager [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-unplugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] No waiting events found dispatching network-vif-unplugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.compute.manager [req-074feffb-f421-4c3a-9f00-57a6fd83b3af req-95d573e9-3ae5-4d96-a728-efe7b03d35be service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-unplugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Instance destroyed successfully.
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.objects.instance [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lazy-loading 'resources' on Instance uuid 60469b9c-ba4c-459b-bb52-12a82d2baffe {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1165697054',display_name='tempest-AttachVolumeNegativeTest-server-1165697054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1165697054',id=50,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC9TfoLuzXVlbnY8RBYk6v1T874sNvUkMLvaxN656fR+hO0dtMyBkPCL0q+2rXlUR5CYOZfN8zNYrfC1VOi4Mn4Tz6m39Jx09oKTDMk8uEXIMw/6cGKNBnss0jPzm69dQ==',key_name='tempest-keypair-308630588',keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3da7cca5578f464eb82b3b8ddf64b92f',ramdisk_id='',reservation_id='r-k55pphwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-698356987',owner_user_name='tempest-AttachVolumeNegativeTest-698356987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7655943dc394a63b416a6817e27a5de',uuid=60469b9c-ba4c-459b-bb52-12a82d2baffe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converting VIF {"id": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "address": "fa:16:3e:4a:89:09", "network": {"id": "9a6e28f3-9d6f-49db-91d2-987b05693c41", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1311462331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3da7cca5578f464eb82b3b8ddf64b92f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f577d31-56", "ovs_interfaceid": "1f577d31-5678-44d1-85b7-f2da2efd8b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG os_vif [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f577d31-56, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4702a229-8114-4514-9d57-093685604452) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:38 user nova-compute[74739]: INFO os_vif [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:89:09,bridge_name='br-int',has_traffic_filtering=True,id=1f577d31-5678-44d1-85b7-f2da2efd8b61,network=Network(9a6e28f3-9d6f-49db-91d2-987b05693c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f577d31-56')
Oct 25 18:40:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Deleting instance files /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe_del
Oct 25 18:40:38 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Deletion of /opt/stack/data/nova/instances/60469b9c-ba4c-459b-bb52-12a82d2baffe_del complete
Oct 25 18:40:38 user nova-compute[74739]: INFO nova.compute.manager [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 25 18:40:38 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:40:38 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:40:39 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:40:39 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Took 0.57 seconds to deallocate network for instance.
Oct 25 18:40:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:39 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:40:39 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:40:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:39 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Deleted allocations for instance 60469b9c-ba4c-459b-bb52-12a82d2baffe
Oct 25 18:40:39 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-f2fb0d33-1422-4a06-9ca3-390bef1dc8f1 tempest-AttachVolumeNegativeTest-698356987 tempest-AttachVolumeNegativeTest-698356987-project-member] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.710s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:40:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] Acquiring lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:40 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] Lock "60469b9c-ba4c-459b-bb52-12a82d2baffe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] No waiting events found dispatching network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:40:40 user nova-compute[74739]: WARNING nova.compute.manager [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received unexpected event network-vif-plugged-1f577d31-5678-44d1-85b7-f2da2efd8b61 for instance with vm_state deleted and task_state None.
Oct 25 18:40:40 user nova-compute[74739]: DEBUG nova.compute.manager [req-834b5d3f-c4a7-415c-9aa6-526254cebc6f req-70899588-2bed-436a-b9cc-9d0d0de597b0 service nova] [instance: 60469b9c-ba4c-459b-bb52-12a82d2baffe] Received event network-vif-deleted-1f577d31-5678-44d1-85b7-f2da2efd8b61 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:40:42 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:40:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:40:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:40:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:40:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:40:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.967296600341797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:40:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:40:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:40:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:40:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:40:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:34 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:41:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:41:45 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:41:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:41:47 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:41:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:41:48 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9179MB free_disk=24.966442108154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:41:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:41:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:41:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:00 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:42:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:42:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:42:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:42:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:42:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:42:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:42:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:42:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:42:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:42:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9196MB free_disk=24.964641571044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:42:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:42:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:42:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:42:57 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:42:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:18 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:36 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:43:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:43:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:43:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:43:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:43:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=24.963356018066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:43:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:43:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:43:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:43:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:44:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:08 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:44:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:44:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:44:12 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:44:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:16 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:16 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:44:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:44:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:37 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:44:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:44:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:44:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:44:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:44:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:44:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:44:48 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:44:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:44:49 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9193MB free_disk=24.953857421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:44:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:44:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:44:59 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:44:59 user nova-compute[74739]: INFO nova.compute.claims [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Claim successful on node user
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:45:00 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.policy [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f3e585c6434dbdb42f433c89c6b66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eb7deb46fb4bfbb4c42ec8313159d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:45:00 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Creating image(s)
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "/opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "/opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "/opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.235s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.171s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk 1073741824" returned: 0 in 0.053s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.172s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Cannot resize image /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Ensure instance console log exists: /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Successfully created port: 4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Successfully updated port: 4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquired lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:45:01 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-changed-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.compute.manager [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Refreshing instance network info cache due to event network-changed-4b554351-5664-4f42-9f24-e294452c4a09. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] Acquiring lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updating instance_info_cache with network_info: [{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Releasing lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Instance network_info: |[{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] Acquired lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Refreshing network info cache for port 4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Start _get_guest_xml network_info=[{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:45:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:45:02 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-122595756',display_name='tempest-VolumesActionsTest-instance-122595756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-122595756',id=51,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-51yl5gn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:45:00Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=1252b6fb-d45a-457d-b950-65105cfd081c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lazy-loading 'pci_devices' on Instance uuid 1252b6fb-d45a-457d-b950-65105cfd081c {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:45:02 user nova-compute[74739]:   <uuid>1252b6fb-d45a-457d-b950-65105cfd081c</uuid>
Oct 25 18:45:02 user nova-compute[74739]:   <name>instance-00000033</name>
Oct 25 18:45:02 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:45:02 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:45:02 user nova-compute[74739]:   <metadata>
Oct 25 18:45:02 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:45:02 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:name>tempest-VolumesActionsTest-instance-122595756</nova:name>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:45:02</nova:creationTime>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:45:02 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:45:02 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:owner>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:user uuid="25f3e585c6434dbdb42f433c89c6b66b">tempest-VolumesActionsTest-1834456652-project-member</nova:user>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:project uuid="31eb7deb46fb4bfbb4c42ec8313159d4">tempest-VolumesActionsTest-1834456652</nova:project>
Oct 25 18:45:02 user nova-compute[74739]:       </nova:owner>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:45:02 user nova-compute[74739]:       <nova:ports>
Oct 25 18:45:02 user nova-compute[74739]:         <nova:port uuid="4b554351-5664-4f42-9f24-e294452c4a09">
Oct 25 18:45:02 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 25 18:45:02 user nova-compute[74739]:         </nova:port>
Oct 25 18:45:02 user nova-compute[74739]:       </nova:ports>
Oct 25 18:45:02 user nova-compute[74739]:     </nova:instance>
Oct 25 18:45:02 user nova-compute[74739]:   </metadata>
Oct 25 18:45:02 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:45:02 user nova-compute[74739]:     <system>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="serial">1252b6fb-d45a-457d-b950-65105cfd081c</entry>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="uuid">1252b6fb-d45a-457d-b950-65105cfd081c</entry>
Oct 25 18:45:02 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:45:02 user nova-compute[74739]:     </system>
Oct 25 18:45:02 user nova-compute[74739]:   </sysinfo>
Oct 25 18:45:02 user nova-compute[74739]:   <os>
Oct 25 18:45:02 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:45:02 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:45:02 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:45:02 user nova-compute[74739]:   </os>
Oct 25 18:45:02 user nova-compute[74739]:   <features>
Oct 25 18:45:02 user nova-compute[74739]:     <acpi/>
Oct 25 18:45:02 user nova-compute[74739]:     <apic/>
Oct 25 18:45:02 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:45:02 user nova-compute[74739]:   </features>
Oct 25 18:45:02 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:45:02 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:45:02 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:45:02 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:45:02 user nova-compute[74739]:   </clock>
Oct 25 18:45:02 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:45:02 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:45:02 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:45:02 user nova-compute[74739]:   </cpu>
Oct 25 18:45:02 user nova-compute[74739]:   <devices>
Oct 25 18:45:02 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:45:02 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:45:02 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk"/>
Oct 25 18:45:02 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:45:02 user nova-compute[74739]:     </disk>
Oct 25 18:45:02 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:45:02 user nova-compute[74739]:       <mac address="fa:16:3e:c4:93:b8"/>
Oct 25 18:45:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:45:02 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:45:02 user nova-compute[74739]:       <target dev="tap4b554351-56"/>
Oct 25 18:45:02 user nova-compute[74739]:     </interface>
Oct 25 18:45:02 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:45:02 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/console.log" append="off"/>
Oct 25 18:45:02 user nova-compute[74739]:     </serial>
Oct 25 18:45:02 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:45:02 user nova-compute[74739]:     <video>
Oct 25 18:45:02 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:45:02 user nova-compute[74739]:     </video>
Oct 25 18:45:02 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:45:02 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:45:02 user nova-compute[74739]:     </rng>
Oct 25 18:45:02 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:45:02 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:45:02 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:45:02 user nova-compute[74739]:     </memballoon>
Oct 25 18:45:02 user nova-compute[74739]:   </devices>
Oct 25 18:45:02 user nova-compute[74739]: </domain>
Oct 25 18:45:02 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-122595756',display_name='tempest-VolumesActionsTest-instance-122595756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-122595756',id=51,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-51yl5gn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:45:00Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=1252b6fb-d45a-457d-b950-65105cfd081c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG os_vif [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62ad7ca0-b476-54b8-9518-c3536b9ffd48', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b554351-56, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b554351-56, col_values=(('qos', UUID('d7d3113a-127f-41df-8cd5-488fd561e3ed')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b554351-56, col_values=(('external_ids', {'iface-id': '4b554351-5664-4f42-9f24-e294452c4a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:93:b8', 'vm-uuid': '1252b6fb-d45a-457d-b950-65105cfd081c'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:02 user nova-compute[74739]: INFO os_vif [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56')
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] No VIF found with MAC fa:16:3e:c4:93:b8, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updated VIF entry in instance network info cache for port 4b554351-5664-4f42-9f24-e294452c4a09. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG nova.network.neutron [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updating instance_info_cache with network_info: [{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:45:02 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-b4963aca-b2b8-4974-9c9f-8225a764b51b req-19eb00d9-0d3a-4a3b-8cdd-e24278ce7def service nova] Releasing lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:45:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] No waiting events found dispatching network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:45:04 user nova-compute[74739]: WARNING nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received unexpected event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 for instance with vm_state building and task_state spawning.
Oct 25 18:45:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] No waiting events found dispatching network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:45:04 user nova-compute[74739]: WARNING nova.compute.manager [req-0fb66f37-e504-4fd2-93e7-fe58f6111e13 req-71b85c89-4abd-4222-afeb-2f6abc38386b service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received unexpected event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 for instance with vm_state building and task_state spawning.
Oct 25 18:45:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:45:05 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Instance spawned successfully.
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:45:05 user nova-compute[74739]: INFO nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 25 18:45:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:45:05 user nova-compute[74739]: INFO nova.compute.manager [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Took 5.95 seconds to build instance.
Oct 25 18:45:05 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8ece7ce8-ac83-4ebc-9c32-0a90cdef297a tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.051s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:45:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:45:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 1252b6fb-d45a-457d-b950-65105cfd081c {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updating instance_info_cache with network_info: [{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:45:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:45:49 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:45:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:45:50 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=24.92397689819336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 1252b6fb-d45a-457d-b950-65105cfd081c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:45:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:45:52 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:45:57 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:45:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:00 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:02 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:07 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:10 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:17 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:27 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:32 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:37 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:46 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:46:47 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:46:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 1252b6fb-d45a-457d-b950-65105cfd081c {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updating instance_info_cache with network_info: [{"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-1252b6fb-d45a-457d-b950-65105cfd081c" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:50 user nova-compute[74739]: INFO nova.compute.manager [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Terminating instance
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-unplugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] No waiting events found dispatching network-vif-unplugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:46:50 user nova-compute[74739]: DEBUG nova.compute.manager [req-23dca5e7-d3df-45c3-93e0-048c7de03a2d req-b814590f-a1c1-46e5-a7a4-0a78478aa888 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-unplugged-4b554351-5664-4f42-9f24-e294452c4a09 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Instance destroyed successfully.
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.objects.instance [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lazy-loading 'resources' on Instance uuid 1252b6fb-d45a-457d-b950-65105cfd081c {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:44:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-122595756',display_name='tempest-VolumesActionsTest-instance-122595756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-122595756',id=51,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:45:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-51yl5gn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:45:06Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=1252b6fb-d45a-457d-b950-65105cfd081c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "4b554351-5664-4f42-9f24-e294452c4a09", "address": "fa:16:3e:c4:93:b8", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b554351-56", "ovs_interfaceid": "4b554351-5664-4f42-9f24-e294452c4a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG os_vif [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b554351-56, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7d3113a-127f-41df-8cd5-488fd561e3ed) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:46:51 user nova-compute[74739]: INFO os_vif [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:93:b8,bridge_name='br-int',has_traffic_filtering=True,id=4b554351-5664-4f42-9f24-e294452c4a09,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b554351-56')
Oct 25 18:46:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Deleting instance files /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c_del
Oct 25 18:46:51 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Deletion of /opt/stack/data/nova/instances/1252b6fb-d45a-457d-b950-65105cfd081c_del complete
Oct 25 18:46:51 user nova-compute[74739]: INFO nova.compute.manager [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:46:51 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Took 0.40 seconds to deallocate network for instance.
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:46:51 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.123s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:46:52 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Deleted allocations for instance 1252b6fb-d45a-457d-b950-65105cfd081c
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-988c786d-a837-442b-97a2-7ec726dfa241 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "1252b6fb-d45a-457d-b950-65105cfd081c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:46:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9138MB free_disk=24.951133728027344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] Acquiring lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] Lock "1252b6fb-d45a-457d-b950-65105cfd081c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] No waiting events found dispatching network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:46:52 user nova-compute[74739]: WARNING nova.compute.manager [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received unexpected event network-vif-plugged-4b554351-5664-4f42-9f24-e294452c4a09 for instance with vm_state deleted and task_state None.
Oct 25 18:46:52 user nova-compute[74739]: DEBUG nova.compute.manager [req-af81e0f5-ac98-4390-a162-732ee0dc69df req-f21765fd-182d-4ef8-af57-2228b871e004 service nova] [instance: 1252b6fb-d45a-457d-b950-65105cfd081c] Received event network-vif-deleted-4b554351-5664-4f42-9f24-e294452c4a09 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:46:56 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:01 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:31 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:36 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:39 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:41 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Starting instance... {{(pid=74739) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74739) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 25 18:47:42 user nova-compute[74739]: INFO nova.compute.claims [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Claim successful on node user
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Start building networks asynchronously for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Allocating IP information in the background. {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] allocate_for_instance() {{(pid=74739) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 25 18:47:42 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Start building block device mappings for instance. {{(pid=74739) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 25 18:47:42 user nova-compute[74739]: DEBUG nova.policy [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '25f3e585c6434dbdb42f433c89c6b66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31eb7deb46fb4bfbb4c42ec8313159d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74739) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Start spawning the instance on the hypervisor. {{(pid=74739) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Creating instance directory {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 25 18:47:43 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Creating image(s)
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "/opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "/opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.186s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk 1073741824 {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880,backing_fmt=raw /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk 1073741824" returned: 0 in 0.053s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "6d09e7f0f4eabdb040d73d57e085236968f7d880" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Successfully created port: 312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d09e7f0f4eabdb040d73d57e085236968f7d880 --force-share --output=json" returned: 0 in 0.176s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk. size=1073741824 {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.virt.disk.api [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Cannot resize image /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk to a smaller size. {{(pid=74739) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Created local disks {{(pid=74739) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Ensure instance console log exists: /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/console.log {{(pid=74739) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:43 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Successfully updated port: 312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquired lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Building network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-changed-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.compute.manager [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Refreshing instance network info cache due to event network-changed-312461be-7721-46a0-bf45-5ff15b338cf0. {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] Acquiring lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Instance cache missing network info. {{(pid=74739) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updating instance_info_cache with network_info: [{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Releasing lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Instance network_info: |[{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74739) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] Acquired lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Refreshing network info cache for port 312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Start _get_guest_xml network_info=[{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fa4bc56a-56a0-4e07-993a-3918bd5a9269'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 25 18:47:44 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:47:44 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU controller missing on host. {{(pid=74739) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.host [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU controller found on host. {{(pid=74739) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74739) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-25T17:43:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-25T17:43:34Z,direct_url=<?>,disk_format='qcow2',id=fa4bc56a-56a0-4e07-993a-3918bd5a9269,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bbb779392b5447ff8f25fe3cc1ea4af2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-25T17:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Flavor limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Image limits 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Flavor pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Image pref 0:0:0 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Got 1 possible topologies {{(pid=74739) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.hardware [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74739) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-663639094',display_name='tempest-VolumesActionsTest-instance-663639094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-663639094',id=52,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-mtk2iezp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:47:43Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74739) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.objects.instance [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] End _get_guest_xml xml=<domain type="kvm">
Oct 25 18:47:44 user nova-compute[74739]:   <uuid>4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5</uuid>
Oct 25 18:47:44 user nova-compute[74739]:   <name>instance-00000034</name>
Oct 25 18:47:44 user nova-compute[74739]:   <memory>524288</memory>
Oct 25 18:47:44 user nova-compute[74739]:   <vcpu>1</vcpu>
Oct 25 18:47:44 user nova-compute[74739]:   <metadata>
Oct 25 18:47:44 user nova-compute[74739]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 25 18:47:44 user nova-compute[74739]:       <nova:package version="0.0.0"/>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:name>tempest-VolumesActionsTest-instance-663639094</nova:name>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:creationTime>2023-10-25 18:47:44</nova:creationTime>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:flavor name="m1.tiny">
Oct 25 18:47:44 user nova-compute[74739]:         <nova:memory>512</nova:memory>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:disk>1</nova:disk>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:swap>0</nova:swap>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:ephemeral>0</nova:ephemeral>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:vcpus>1</nova:vcpus>
Oct 25 18:47:44 user nova-compute[74739]:       </nova:flavor>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:owner>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:user uuid="25f3e585c6434dbdb42f433c89c6b66b">tempest-VolumesActionsTest-1834456652-project-member</nova:user>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:project uuid="31eb7deb46fb4bfbb4c42ec8313159d4">tempest-VolumesActionsTest-1834456652</nova:project>
Oct 25 18:47:44 user nova-compute[74739]:       </nova:owner>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:root type="image" uuid="fa4bc56a-56a0-4e07-993a-3918bd5a9269"/>
Oct 25 18:47:44 user nova-compute[74739]:       <nova:ports>
Oct 25 18:47:44 user nova-compute[74739]:         <nova:port uuid="312461be-7721-46a0-bf45-5ff15b338cf0">
Oct 25 18:47:44 user nova-compute[74739]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 25 18:47:44 user nova-compute[74739]:         </nova:port>
Oct 25 18:47:44 user nova-compute[74739]:       </nova:ports>
Oct 25 18:47:44 user nova-compute[74739]:     </nova:instance>
Oct 25 18:47:44 user nova-compute[74739]:   </metadata>
Oct 25 18:47:44 user nova-compute[74739]:   <sysinfo type="smbios">
Oct 25 18:47:44 user nova-compute[74739]:     <system>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="product">OpenStack Nova</entry>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="version">0.0.0</entry>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="serial">4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5</entry>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="uuid">4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5</entry>
Oct 25 18:47:44 user nova-compute[74739]:       <entry name="family">Virtual Machine</entry>
Oct 25 18:47:44 user nova-compute[74739]:     </system>
Oct 25 18:47:44 user nova-compute[74739]:   </sysinfo>
Oct 25 18:47:44 user nova-compute[74739]:   <os>
Oct 25 18:47:44 user nova-compute[74739]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 25 18:47:44 user nova-compute[74739]:     <boot dev="hd"/>
Oct 25 18:47:44 user nova-compute[74739]:     <smbios mode="sysinfo"/>
Oct 25 18:47:44 user nova-compute[74739]:   </os>
Oct 25 18:47:44 user nova-compute[74739]:   <features>
Oct 25 18:47:44 user nova-compute[74739]:     <acpi/>
Oct 25 18:47:44 user nova-compute[74739]:     <apic/>
Oct 25 18:47:44 user nova-compute[74739]:     <vmcoreinfo/>
Oct 25 18:47:44 user nova-compute[74739]:   </features>
Oct 25 18:47:44 user nova-compute[74739]:   <clock offset="utc">
Oct 25 18:47:44 user nova-compute[74739]:     <timer name="pit" tickpolicy="delay"/>
Oct 25 18:47:44 user nova-compute[74739]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 25 18:47:44 user nova-compute[74739]:     <timer name="hpet" present="no"/>
Oct 25 18:47:44 user nova-compute[74739]:   </clock>
Oct 25 18:47:44 user nova-compute[74739]:   <cpu mode="custom" match="exact">
Oct 25 18:47:44 user nova-compute[74739]:     <model>Nehalem</model>
Oct 25 18:47:44 user nova-compute[74739]:     <topology sockets="1" cores="1" threads="1"/>
Oct 25 18:47:44 user nova-compute[74739]:   </cpu>
Oct 25 18:47:44 user nova-compute[74739]:   <devices>
Oct 25 18:47:44 user nova-compute[74739]:     <disk type="file" device="disk">
Oct 25 18:47:44 user nova-compute[74739]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 25 18:47:44 user nova-compute[74739]:       <source file="/opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk"/>
Oct 25 18:47:44 user nova-compute[74739]:       <target dev="vda" bus="virtio"/>
Oct 25 18:47:44 user nova-compute[74739]:     </disk>
Oct 25 18:47:44 user nova-compute[74739]:     <interface type="ethernet">
Oct 25 18:47:44 user nova-compute[74739]:       <mac address="fa:16:3e:ad:2d:54"/>
Oct 25 18:47:44 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:47:44 user nova-compute[74739]:       <mtu size="1442"/>
Oct 25 18:47:44 user nova-compute[74739]:       <target dev="tap312461be-77"/>
Oct 25 18:47:44 user nova-compute[74739]:     </interface>
Oct 25 18:47:44 user nova-compute[74739]:     <serial type="pty">
Oct 25 18:47:44 user nova-compute[74739]:       <log file="/opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/console.log" append="off"/>
Oct 25 18:47:44 user nova-compute[74739]:     </serial>
Oct 25 18:47:44 user nova-compute[74739]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 25 18:47:44 user nova-compute[74739]:     <video>
Oct 25 18:47:44 user nova-compute[74739]:       <model type="virtio"/>
Oct 25 18:47:44 user nova-compute[74739]:     </video>
Oct 25 18:47:44 user nova-compute[74739]:     <rng model="virtio">
Oct 25 18:47:44 user nova-compute[74739]:       <backend model="random">/dev/urandom</backend>
Oct 25 18:47:44 user nova-compute[74739]:     </rng>
Oct 25 18:47:44 user nova-compute[74739]:     <controller type="usb" index="0" model="none"/>
Oct 25 18:47:44 user nova-compute[74739]:     <memballoon model="virtio">
Oct 25 18:47:44 user nova-compute[74739]:       <stats period="10"/>
Oct 25 18:47:44 user nova-compute[74739]:     </memballoon>
Oct 25 18:47:44 user nova-compute[74739]:   </devices>
Oct 25 18:47:44 user nova-compute[74739]: </domain>
Oct 25 18:47:44 user nova-compute[74739]:  {{(pid=74739) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-663639094',display_name='tempest-VolumesActionsTest-instance-663639094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-663639094',id=52,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-mtk2iezp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-25T18:47:43Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG os_vif [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77') {{(pid=74739) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab5bda37-558b-50e1-903d-ce00f2f364c3', '_type': 'linux-noop'}}, row=False) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312461be-77, may_exist=True, interface_attrs={}) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap312461be-77, col_values=(('qos', UUID('1018798f-73c6-412c-a08f-369efe91f529')),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap312461be-77, col_values=(('external_ids', {'iface-id': '312461be-7721-46a0-bf45-5ff15b338cf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:2d:54', 'vm-uuid': '4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5'}),), if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:44 user nova-compute[74739]: INFO os_vif [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77')
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74739) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] No VIF found with MAC fa:16:3e:ad:2d:54, not building metadata {{(pid=74739) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updated VIF entry in instance network info cache for port 312461be-7721-46a0-bf45-5ff15b338cf0. {{(pid=74739) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG nova.network.neutron [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updating instance_info_cache with network_info: [{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:47:44 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-79796ff8-7f2e-4480-a82a-6c2a9af51547 req-392c73e4-958a-433a-96c8-ea3a0e19e37d service nova] Releasing lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:47:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:45 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] No waiting events found dispatching network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:47:46 user nova-compute[74739]: WARNING nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received unexpected event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 for instance with vm_state building and task_state spawning.
Oct 25 18:47:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] No waiting events found dispatching network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:47:46 user nova-compute[74739]: WARNING nova.compute.manager [req-67d4975d-2f0b-47b0-b00e-ea351aef99ae req-085a1129-9fec-434a-890b-3bdb008d582b service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received unexpected event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 for instance with vm_state building and task_state spawning.
Oct 25 18:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:46 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:47 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Instance event wait completed in 0 seconds for  {{(pid=74739) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 25 18:47:47 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Guest created on hypervisor {{(pid=74739) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 25 18:47:48 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Instance spawned successfully.
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_cdrom_bus of ide {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_disk_bus of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_input_bus of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_pointer_model of None {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_video_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.virt.libvirt.driver [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Found default for hw_vif_model of virtio {{(pid=74739) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 25 18:47:48 user nova-compute[74739]: INFO nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Took 5.09 seconds to spawn the instance on the hypervisor.
Oct 25 18:47:48 user nova-compute[74739]: DEBUG nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Checking state {{(pid=74739) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 25 18:47:48 user nova-compute[74739]: INFO nova.compute.manager [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Took 5.65 seconds to build instance.
Oct 25 18:47:48 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-eaa9e5dc-f377-4741-9c1e-49ea72182a56 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.742s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:47:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:47:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updating instance_info_cache with network_info: [{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:47:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:47:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:47:51 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:47:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:47:52 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=24.94940185546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:47:52 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:47:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:47:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:02 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:06 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:11 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:16 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:21 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:34 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:39 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:41 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:44 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:48 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquired lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Forcefully refreshing network info cache for instance {{(pid=74739) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 25 18:48:49 user nova-compute[74739]: DEBUG nova.objects.instance [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lazy-loading 'info_cache' on Instance uuid 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:48:50 user nova-compute[74739]: DEBUG nova.network.neutron [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updating instance_info_cache with network_info: [{"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:48:50 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Releasing lock "refresh_cache-4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" {{(pid=74739) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 25 18:48:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updated the network info_cache for instance {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:48:53 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.processutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74739) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:48:54 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:48:54 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=24.92102813720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Instance 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74739) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:48:54 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:48:59 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:03 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:04 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:04 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:49:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:09 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:14 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:15 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:19 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:22 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:22 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:24 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:25 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:49:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:49:25 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:29 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:33 user nova-compute[74739]: INFO nova.compute.manager [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Terminating instance
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Start destroying the instance on the hypervisor. {{(pid=74739) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-unplugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] No waiting events found dispatching network-vif-unplugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [req-d57393d3-a00a-4880-8473-f6f82a55b792 req-0895d0c4-694b-4af4-9379-0eda5b8acfba service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-unplugged-312461be-7721-46a0-bf45-5ff15b338cf0 for instance with task_state deleting. {{(pid=74739) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Instance destroyed successfully.
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.objects.instance [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lazy-loading 'resources' on Instance uuid 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5 {{(pid=74739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.virt.libvirt.vif [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-25T18:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-663639094',display_name='tempest-VolumesActionsTest-instance-663639094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-663639094',id=52,image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-25T18:47:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31eb7deb46fb4bfbb4c42ec8313159d4',ramdisk_id='',reservation_id='r-mtk2iezp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fa4bc56a-56a0-4e07-993a-3918bd5a9269',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1834456652',owner_user_name='tempest-VolumesActionsTest-1834456652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-25T18:47:48Z,user_data=None,user_id='25f3e585c6434dbdb42f433c89c6b66b',uuid=4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converting VIF {"id": "312461be-7721-46a0-bf45-5ff15b338cf0", "address": "fa:16:3e:ad:2d:54", "network": {"id": "30b4a811-c833-4219-89fa-d9c3d45bd7f8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2016445784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31eb7deb46fb4bfbb4c42ec8313159d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312461be-77", "ovs_interfaceid": "312461be-7721-46a0-bf45-5ff15b338cf0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.network.os_vif_util [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77') {{(pid=74739) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG os_vif [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77') {{(pid=74739) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312461be-77, bridge=br-int, if_exists=True) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1018798f-73c6-412c-a08f-369efe91f529) {{(pid=74739) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:33 user nova-compute[74739]: INFO os_vif [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2d:54,bridge_name='br-int',has_traffic_filtering=True,id=312461be-7721-46a0-bf45-5ff15b338cf0,network=Network(30b4a811-c833-4219-89fa-d9c3d45bd7f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312461be-77')
Oct 25 18:49:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Deleting instance files /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5_del
Oct 25 18:49:33 user nova-compute[74739]: INFO nova.virt.libvirt.driver [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Deletion of /opt/stack/data/nova/instances/4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5_del complete
Oct 25 18:49:33 user nova-compute[74739]: INFO nova.compute.manager [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 25 18:49:33 user nova-compute[74739]: DEBUG oslo.service.loopingcall [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74739) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.compute.manager [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Deallocating network for instance {{(pid=74739) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 25 18:49:33 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] deallocate_for_instance() {{(pid=74739) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 25 18:49:34 user nova-compute[74739]: DEBUG nova.network.neutron [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Updating instance_info_cache with network_info: [] {{(pid=74739) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 25 18:49:34 user nova-compute[74739]: INFO nova.compute.manager [-] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Took 0.38 seconds to deallocate network for instance.
Oct 25 18:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:34 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:49:34 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:34 user nova-compute[74739]: INFO nova.scheduler.client.report [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Deleted allocations for instance 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5
Oct 25 18:49:34 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-e3e2a249-4845-41c2-8c15-3efdac7abfb7 tempest-VolumesActionsTest-1834456652 tempest-VolumesActionsTest-1834456652-project-member] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.336s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] Acquiring lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:35 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] Lock "4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] No waiting events found dispatching network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 25 18:49:35 user nova-compute[74739]: WARNING nova.compute.manager [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received unexpected event network-vif-plugged-312461be-7721-46a0-bf45-5ff15b338cf0 for instance with vm_state deleted and task_state None.
Oct 25 18:49:35 user nova-compute[74739]: DEBUG nova.compute.manager [req-06c0cb94-fd9e-4447-ad05-508f830c2780 req-912d48bf-9fc5-4924-88a7-f507a51ee694 service nova] [instance: 4b8bc9a4-15ad-41a6-aef0-2a94a021dcd5] Received event network-vif-deleted-312461be-7721-46a0-bf45-5ff15b338cf0 {{(pid=74739) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 25 18:49:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:43 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:49:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:49:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:49:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:55 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:49:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:49:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=24.948246002197266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:49:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:49:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:50:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:12 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:50:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:50:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:50 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:50:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:50:50 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:50:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:50:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:50:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:50:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:50:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:50:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:50:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=24.036510467529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:50:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:50:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:50:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:50:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:05 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:05 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:51:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:51:17 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:20 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:22 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:51:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:51:44 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:52 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:51:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:51:52 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:51:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:51:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:51:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:51:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:51:55 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:51:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:51:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9175MB free_disk=24.94582748413086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:51:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:51:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:51:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:51:59 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:06 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:52:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:52:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:19 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:52:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:45 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:52:53 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:52:53 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:52:55 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:52:55 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:52:55 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:52:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:52:56 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9163MB free_disk=24.944271087646484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:52:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:52:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:52:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:01 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:07 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:07 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:53:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:53:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74739) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74739) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 25 18:53:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:20 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:26 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:53:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:53:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:47 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:53:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:53:54 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:53:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:53:54 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:53:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:53:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:53:56 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:53:56 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:53:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:53:57 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=24.934959411621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing inventories for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating ProviderTree inventory for provider 3998dc2a-c940-46be-8c01-65f11782a00e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Updating inventory in ProviderTree for provider 3998dc2a-c940-46be-8c01-65f11782a00e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing aggregate associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, aggregates: None {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Refreshing trait associations for resource provider 3998dc2a-c940-46be-8c01-65f11782a00e, traits: COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74739) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:53:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:53:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:58 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:53:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:02 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:06 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:08 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:54:09 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:09 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74739) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 25 18:54:11 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:13 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:54:14 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:18 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:21 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:23 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:28 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] There are 1 instances to clean {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] [instance: 7926c5ce-2435-4493-813f-4dca6e1f204f] Instance has had 5 of 5 cleanup attempts {{(pid=74739) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:31 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74739) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 25 18:54:33 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:38 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:54:42 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:43 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:48 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:54:49 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:53 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:54:56 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Starting heal instance info cache {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 25 18:54:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Rebuilding the list of instances to heal {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 25 18:54:56 user nova-compute[74739]: DEBUG nova.compute.manager [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Didn't find any instances for network info cache update. {{(pid=74739) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 25 18:54:57 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:54:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:54:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:54:57 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:54:57 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Auditing locally available compute resources for user (node: user) {{(pid=74739) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 25 18:54:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:54:58 user nova-compute[74739]: WARNING nova.virt.libvirt.driver [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Hypervisor/Node resource view: name=user free_ram=9277MB free_disk=24.931682586669922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74739) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74739) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.compute.provider_tree [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed in ProviderTree for provider: 3998dc2a-c940-46be-8c01-65f11782a00e {{(pid=74739) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.scheduler.client.report [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Inventory has not changed for provider 3998dc2a-c940-46be-8c01-65f11782a00e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74739) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG nova.compute.resource_tracker [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Compute_service record updated for user:user {{(pid=74739) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG oslo_concurrency.lockutils [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=74739) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 25 18:54:58 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 25 18:55:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:55:00 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 25 18:55:03 user nova-compute[74739]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74739) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 25 18:55:04 user nova-compute[74739]: DEBUG oslo_service.periodic_task [None req-8683b498-5355-4499-8f52-c3f7474c7693 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74739) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}